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I. BACKGROUND LEADING TO EXPERIMENTATION 



A. INTRODUCTION 

This thesis investigates the potential application of 
automatic speech recognition (ASP.) technology to military 
imagery interpretation reporting. It stems from the 
author's background in three areas: imagery interpretation, 
Intelligence Data Handling Systems (IDES), and recent 
exposure to the benefits of voice data entry as an 
alternative modality for interacting with machines, 
especially computers. 

The need for the thesis arises from two areas: the need 
tc evaluate and advance current ASP technology without major 
redesign of systems) and the need for faster, reliable 
reporting systems for the intelligence community. Dr. Wayne 
Lea and Dr. Gary Poock called for the evaluation of state- 
of-the-art ASR equipment, specifically, to evaluate input 
modalities, e.g. voice versus typing [Refs. 1 and 2]. The 
intelligence community is continually seeking ways tc 
improve performance of imagery sensors and exploitation and 
reporting systems, and is very interested in ways of 
reducing costs while improving the quality of intelligence 
to tactical and strategic users. 

The Soviet Union and the Warsaw Pact countries are 
expected to employ mass, mobility, and surprise tactics in 
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any future European attack scenario on our North Atlantic 
Treaty Organization (NATO) Allies. The speed and range of 
rrodern weaponry leave little or no room for mistakes in 
responding to crisis situations. Decision-making in minutes 
or even seconds is a requirement today, and is likely to be 
more critical in the future with the increased use cf 
microelectronic components for sensor and weapons control, 
and faster, more redundant, survivable, and interoperable 
communications facilities. National Command Authorities, 
U.S. Strategic and Tactical Forces, and NATO Theater Forces 
must have accurate, timely, and complete indications and 
warning (I&W) intelligence of the enemy's real intentions 
and capabilities. Once hostilities begin, with today's 
warfighting technology, military commanders will require 
near-real-time (NRT) combat information to enable them to 
provide effective command and control of their forces to 
counter the enemy. 

Globally, intelligence must be available for 
national security decisions regarding appropriate 
responses to international terrorism and the unwarranted 
intervention of foreign powers into the affairs of 
other nations. Additionally, intelligence is 
required for long-range planning estimates to support the 
acquisition of the best possible mix of forces to 
meet mission requirements in support of basic U.S. 
policy and objectives. Finally, intelligence must 
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continually support Strategic Nuclear Command and Control 
forces which rust always be at a sufficient state of 
readiness tc provide nuclear deterrence. 

The following basic commend and control model in Figure 
1 was adapted frcm the work of Dr. Joel Lawson, Technical 
Director, Naval Electronics Systems Command r Hef. 3]. It is 
shown here to illustrate the importance of tne intelligence 
process in providing support to command and control of 
forces in war and peace. Note that it does little good tc 
provide better sensors without also improving the ability to 
compare the information derived with objectives and 
historical information in conjunction with intelligence 
analysis, inherent in the "compare" process. In the 
reconnaissance area, imagery exploitation and reporting 
would fall under the "compare" function of the system, and 
as such can be a major information "bottleneck" if not 
capable of effectively processing the sensor output to meet 
the information needs of the decision-maker. 
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Figure 1. Basic Command and Control Model 
Regarding the central importance of the command and 
control process, Dr. Lawson states, 



...the central problem of command control is producing 
an up-to-date geographic display of the location of 
"things.” Besides purely the location of things he [the 
commander] needs to know what [the] things are, what is 
their identity, or who do they belong to and what is 
their status . 



Imagery is a key source of such information, and is thus a 
major contributor to the command and control process. 

Automated imagery interpretation reporting systems have 
been employed for strategic and theater support for over 1C 
years, and new systems which include exploitation aids are 
being deployed to tactical units now. They have 
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significantly reduced the tine tc exploit and report all 
types of imagery intelligence. However, the man-machine 
interface research and development of these systems must 
continue to meet future challenges facing the intelligence 
community. Significant volumes of imagery intelligence will 
be available from NET digital imagery sensors in the future, 
and the best possible man-machine interface must be sought 
to effectively exploit IS 1 *', order of battle, targeting, and 
damage assessment intelligence available from imagery. 

Reporting speed and accuracy, manpower reducti cns ,and 
increased throughput are worthy design goals for new or 
improved imagery exploitation and reporting systems. Voice 
data entry is one newly evolving technology that offers 
significant potential toward these goals. Dr. Wayne Lea, in 
the introduction to his book Trends in Speech Recognition, 
1980, said: 

Speech input seems to offer a truly natural mode of 
human-machine communication that, if attainable in a 
cost-effective way, would be unsurpassed in making 
computers and other mechanical devices truly cooperative 
servants of mankind, rather than increasing the demands 
on the human to adapt to the machine [Ref. 4] . 

The next section briefly overviews the functions of 
imagery reporting systems, provides some examples of 
systems for today and tomorrow, and mentions some specific 
requirements which lead to the desirability of voice 
data entry for imagery intelligence reporting. 
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3. IMAGERY INTERPRETATION REPORTING SYSTEMS 



1 . Func t i ons 

A military imagery interpretation system basically 
functions to provide support for first, second, and third 
phase exploitation of multi-sensor imagery in response to 
tasking from parent or outside user organizations. These 
phases represent three levels of depth of imagery analysis 
in accordance with Defense Intelligence Agency (DIA) 
standard reporting procedures, data elements, and 
requirements . 

First and second phase reports represent the bulk of 
the work, and are called Initial/Supplementary Fhoto 
Interpretation Reports ( I PIRs/SUP IRs ) . The IPIR may be 
thought of as a quick, concise response to time-sensitive 
requirements. It .is often followed by the SUPIR, which 
represents a mere detailed and thorough exploitation effort. 
Third phase reporting is the most detailed, and includes 
special analyses and reporting of selected installations of 
specific interest to users of imagery products. 

Such reporting standards and systems grew out of 
requirements forced by large increases in the volume of 
available imagery during the sixties. During the sixties, 
the volume of imagery exceeded the exploitation capabilities 
by a factor of five to ten [Ref. 5]. This drove the 
development of a variety of imagery exploitation and 
reporting systems which came into operation in the 
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seventies, and forced standards fcr reporting cn the imagery 
intelligence community as a whole. These developments 
permitted the sharing of imagery intelligence via magnetic 
tape files and bulk data transfers over communications 
circuits. It also facilitated the integration of imagery 
intelligence intc more general data bases, and enhanced the 
corporate memory” of intelligence units, since interpreters 
often kept installation data in small personal files, net 
easily accessed by others. With better data bases, 
exploitation was enhanced and duplication of effort was 
reduced . 

Today, imagery exploitation systems are located 
worldwide in support of U.S. military commanders. The focus 
now is on providing more integrated data bases, which are 
optimally dynamic, complete, and timely. Kulti-scurce 
imagery reports may be telecommunicated to and from many of 
the sites, and distributed to users with a valid 
requirement. Integrated data bases will afford producers 
and users with more responsive, coordinated information in 
time of need. 

Imagery systems range from national level to 
tactical reconnaissance squadron level systems. They have 
become increasingly capable of supporting many tasks 
associated with exploitation and reporting: responding to 
tasking transmitted over telecommunications networks? 
managing interpretation hardware, software, and data base 
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resources; exploiting the imagery to include making 

measurements on the imagery, correlating imagery with maps, 
composing reports, editing them, and other support 

functions; disseminating reports; and automatic screening 
and updating cf local imagery and multi-source data bases. 

2 . Examples of Imagery Interpretation Reporting Systems 
The EIA uses the Automated Imagery Related 

Exploitation System (aIRES), modeled after the PACER system 
used by the Strategic Air Command's 544th Aerospace 

Reconnaissance Technical Wing. PACER means Program Assisted 



Console 


Evaluation 


and Review, 


and consists of a 


dual 


Honeywell 


6083 


based computer 


system 


and UNIVAC 


1652 


consoles 




supporting the interpretation 


process . 


Both 


systems 


support a 


wide variety of 


analyst 


functions . 






A 


s ys t em 


developed and 


installed in the 


late 



seventies for theater and tactical user support is the 
Computer Assisted Tactical Information System (CATIS). This 
system is used by fixed-site, imagery exploitation units in 
the Pacific Air Forces (PACAE), the Tactical Air Command 
(TAC), the Fleet Intelligence Center for Europe and the 
Atlantic ( FICEUR1ANT) , the United States Air Forces in 
Europe (USAFE), and the training site in Air Training 
Command (ATC). The imagery exploitation support provided by 
CATIS may be viewed in Figure 2. 

To provide hignly mobile support, the Tactical 
Information Processing and Interpretation, Imagery 
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Interpretation System (TIPI IIS) was developed, and is being 
deployed to Air Force, Marine, and Army tactical 
reconnaissance support units worldwide. The photo 
interpretation console of the TIPI IIS may be viewed in 
Figure 3, displaying a great deal of modular, ruggedized 
support equipment for imagery interpretation reporting and 
communications. This system provides mobile automation at 
the squadron level, not previously available. For example, 
an interpreter can use a cursor in the light table tc make 
rapid, accurate measurements of objects such as bridges, 
runways, and storage tauks and store the answer on an 
electronic scratch pad for later insertion into a report. 
Reports are filled in quickly, using a f i 11 -i n-the-blank 
online report composer. They may then be edited by a 
supervisor, and distributed over secure communications 
links . 

To perform side-looking airborne radar (SLAR) 
exploitation and reporting the TIPI Manual Radar 
Reconnaissance Exploitation System (MARRFS) was 
developed, but with a different ccnscle (Figure 4). This 
system provides special readout of radar imagery that may be 
used in good or bad weather, and is useful for discovering 
enemy force movements in inclement weather, such as that 
found in Europe. Unique man-machine systems have been 
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‘i^ure- c. CAT1S Irc^Er/ .ixplc i tc ti or. Suppc: 
(Acanted frorr CATIS User's Manual, 1979) 
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Pi^ure 3. TIPI Imager/ Interpretation Syste"- (IIS) 
(Courtesy of Texes Instruments, Inc.) 
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1 1 1 [-iar.ua 1 Radar Reconnaissance Exploitation Syster, (t'ARP.E 
tCouriesy of lexas 1 nstrurents Inc.) 



provided to assist in providing detection of changes in the 
landscape or order of battle. 

New NRT digital imagery reconnaissance sensors, 
such as foward-looking infrared imagery (FLIR), Synthetic 
Aperature Radar \SAR), or other types of imagery 
which can be supported by sensors on tactical aircraft 
will result in increased NRT imagery. Exploitation 
systems to support the sensors must be developed to provide 
the additional support required. The Air Force has 
initiated advanced developmental models to prepare for 
such a requirement. 

Cne system is the Reconna i ssa nee Reporting 
Facility developed to support the Quick Strike 
Reconnaissance concept whereby the reporting facility would 
receive NRT hardcopy and softcopy (digital) imagery from 
reconnaissance aircraft over the forward edge of the battle 
area. When advancing enemy forces posed themselves as 
targets of opportunity, imagery reports would notify the 
strike center to order nearby airborne loitering 
aircraft to destroy the target. Figure 5, top and 
bottom, gives views of the shelter developed to test 
the NRT reporting concept. 
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Figure 



5. QSR Reconnaissance Reporting 
(Courtesy of Texas Instruments, 



Facility 
Inc. ) 



( RRJ ) 
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Figure 6. Compass Preview 
Digital Exploitation System 
iCourtesy of Northrop Corporation) 








The P.RF contains computers, communications, and both 
hardcopy and softcopy imagery exploitation and reporting 
stations. Used during exploitation of a target-rich 
wartime environment, this facility would pose a 
challenging work environment for the best of interpreters 
and supervisors. Efforts to optimize the man-computer 
interface could only result in improved responsiveness and 
greater system capability. 

Another system, for strategic use, is the Compass 
Preview digital imagery exploitation system shown in Figure 
6. For the first time, interpreters will be able to view 
stereo images without the aid of a light table, hardcopy 
imagery, or a stereoscope. The interpreter can use computer 
support to enhance the image to improve its interpretab il ity 
in terms of scale, contrast, sharpness, and other image 
qualities. Simultaneously, historical data base information 
and reporting formats are available for reporting what is 
seen on the image and correlated with other data. 
Measurements may also be made using a joystick and cursor. 

The imagery systems discussed represent a large leap 
forward in imagery intelligence since the late sixties. The 
results from current systems such as PACER and CATIS are 
encouraging with 3:1 and 12:1 increases in output as 
compared to their predecessors, less duplication of effort, 
increased validity of reporting, and most importantly, 
better responsiveness to specific user questions. 
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Imagery reporting systems are quite 
sophisticated, having incorporated not only state-of- 
the-art exploitation techniques, hut others as 
well from computer, communications, and other 
intelligence disciplines. Significant skill and 
training are required to operate them effectively. 
Interpreters are not trained typists, and thus their speed 
may slow the reporting process. Additionally, they may 
nave an inherent fear of working- with computers. 
Continuing attention must he given to improving the 
man-machine interface to optimize the system product: 
complete, accurate, and timely imagery intelligence. Though 
not a panacea, voice data entry may be part of the solution 
for improving the imagery interpretation systems, by 
improving man's interface with the machine, and making 
optimal use of man's skills as an image analyst. 



3 . Requirement for Voice Data antry 



During 


the author 's 


recent assignment 


at 


the Armed 


Forces Air Intelligence Training Center, 


he 


was 


responsible 


for managing 


the initial 


devel cpmen t 


o f 


the 


TIPI IIS 


Operator and 


Supervisor 


Courses . 


As 


he 


observed 



interpreters training on the prototype, it was often 
apparent that they were deficient in typing skills. It was 
painfully obvious that the multi-million dollar IIS would 
not produce reports any faster than the few words-per-minute 
of the "hunt and peck" typist. Certainly, with practice 
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individuals may improve their typing speed and accuracy as 
they adapt to a system, but as we have seen, the tread is 
toward faster reporting, and somehow the problem of data 
entry must be attacked or critical resources will be wasted 
cn systems limited by the the man-in-the-1 oop . 

One simple and effective way may be to conduct 
typing classes to improve interaction with the computer. In 
fact, online routines for teaching better typing could be 
developed to improve the interpreters' skills between 
missions. Another way may be to use voice data entry, which 
offers a great potential beyond even the fastest typists for 
data entry, should be easier and faster to train, and could 
be used in conjunction with typing, function keys, or a 
variety of other input modalities. 

G. AUTOMATIC SPEECH RECOGNITION 
1 . Overvi ew 

Automatic Speech Recognition (ASR) is no longer a 
dream of the future, but a technology being applied around 
the world by people who use machines, allowing effective 
machine control and data entry into computers. ASR is not 
without problems or limitations however, and must be 
carefully examined before trying to apply it. Human factors 
must be studied and tailored to the application to allow ASR 
to have the appropriate impact it affords. Failure to 
attend to operator considerations such as microphone 
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counting, recognition accuracy, error correction, response 
time and delay, feedback and prompting, stability of 
reference data, and training procedures can have 
catastrophic effects on system performance for both the 
voice system and the system it aids [Ref. 7] . 

The ultimate goal for speech recognition 
science is to develop "speech understanding systems" 
which give the appropriate response to the user's 
request, and do not just recognize tne elements of speech or 
words and phrases [Ref. 8]. Admittedly, the technology is 
not that far along, but many applications dc not need cr 
cannot afford the ideal speech system. The question that 
must be asked now is "what applications can be 
accomplished in a more cost-effective manner witn voice 
recognition systems that are available now or will be 
available within the neit few years?" 

Speech scientists have been working on ASR for about 
28 years . Commercially available speech recognizers became 
available in 1972 with Scope Electronics, Inc. and Threshold 
Technology Inc. delivering quality systems which achieved 
significant results under a variety of conditions. In 
general, recognition accuracy scores from 99.0% to 99.9% 
accuracy have been achieved in laboratory conditions of no 
noise, adequate talker training, and consistent talking 
habits. Field testing, however has usually achieved results 
in the neighborhood of 97% recognition accuracy, generally 
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as a result cf high background noises or speaking tc the 
system in a manner different than the way the system was 
trained initially. 

All ASR systems fall into either of two 
categories: continuous (connected) or isolated (discrete) 
speech systems [Ref. 9]. Continuous speech systems work on 
the extraction of information from strings of words 
that may be run together in natural speech in the form of 
strings of digits, phrases, or sentences. I s dated -word 
recognizers require that a short minimum-duration pause 
be inserted between digits, words or phrases which must be 
spoken within a given period of time, e.g. two seconds. 

These isolated-word recognizers are more prevalent 
today as they are less expensive, more accurate, work in 
real-time, ana are more readily available. Continuous 
speech systems, however, may be available within the next 
few years offering 250 word vocabularies and recognition 
in real-time at a reasonable price. Continuous speech 
systems, in the upper end of the cost spectrum, are 
approximately $120,000. High quality isolated-word speech 
recognizers normally cost in the tens of thousands of 
dollars today? however, a few companies are also introducing 
systems on the market for a few thousand dollars that 
can recognize vocabularies of about 250 words with 
recognition accuracies of 97 % or better, according tc 
Dr.Poock, who intends to compare such systems at NPS for 
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command and control applications. At the bottom end 
of the cost spectrum, hobby systems are currently available 
for a few hundred dollars. 

Dr. Lea, well recognized for his work in speecn science 
at the University of Southern California and the Speech 
Communication Research Laboratory said this about the future 
of speech recognition technology: 



The next ten years or more would seem to offer a growing 
spectrum of available devices, ranging from very low 
cost isolated word recognizers, through digit string 
recognizers, recognizers of strictly formatted word 
sequences, task-restricted speech understanding systems, 
and more powerful research systems for continuous speech 
recognition. All such systems will take advantage of 
low-cost miniaturization hardware that puts speech 
recognizers within the reach of most potential users... 
User acceptance of voice input will approach the 
"matter-of-fact" attitudes now prevalent with limited 
keyboard entry, even though full versatility and 
"habitability" of input languages will not have been 
attained to any major degree... Despite all these 
advances, we will be far from the science fiction image 
of fully versatile voice interaction with machines, and 
I doubt that unrestricted "phonetic typewriters" are a 
part of the next decade or more of practical work on 
speech recognition [Ref 10] . 
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Speech systems offer the potential to capitalize 
on the best of man's communicative abilities, give him 
compatibility with unusual circumstances, and help him gain 
additional mobility and freedom in some situations [Ref. 
11]. Speech is said to be the human's most natural 
communication modality. It is familiar, convenient, and can 
be used spontaneously because the individual uses it often 
in all types of situations. Though performance with voice 
may degrade under situations of stress, it may not degrade 
as much as a less learned, less frequently used skill. 
Since voice is familiar to the user, it is less difficult to 
train him to use the system. Additionally, voice is the 
human's highest-capacity output channel, and permits 
simultaneous communications with humans and machines. Fcr 
example, a speaker in a large auditorium or a command center 
can display the next visual on a large screen display by 
saying some key phrase or word which has meaning to both 
listener and display system. To illustrate, when Dr. Pocck 
recently briefed a group of senior naval officers in the 
Pacific, he used such key phrases as ’’Good Corning 
Admiral..." to begin his briefing, and "here you see the 
(pause) SHIPS ..." to convey briefing information and tell 
the command and control graphics display system to present 
the next graphic in his presentation on the subject of Voice 
Input for Command and Control. This is just one 
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illustration of the creative ways man can use voice input to 
his advantage. 

Navy feasibility studies sponsored by Naval 
Ilectronics Systems Command, and conducted by Dr. Poock, 
examined the potential for voice data entry fcr commend, 
control, communications, and intelligence. Two voice 
recognition systems were installed in late I960 at Fleet 
Headquarters, Commander-in-Chief of the Pacific (CINCPAC) in 
Hawaii to examine the benefits and limitations of voice 
input for operation of the Worldwide Military Command and 
Control Time-Sharing System (WWMCCS TS5) and the nearby 
Ocean Surveillance Intelligence System (OSIS). One 
advantage of many of the new voice terminals is that they 
are stand-alone, intelligent terminals with standard 
communications interfaces and character sets that can be 
interfaced rapidly with computers possessing those same 
generic interfaces. Voice units may be moved around easily 
and installed as simply as most ether modern RS-232 plug- 
compatible terminals. Voice may also be used remotely as 
much as 2002 feet from the main computer, free from any 
panel space, displays, or complex apparatus. 

The advantages of voice input fcr 
complementing the communicative abilities of man are 
offset somewhat today since a user cannot speak totally 
naturally, but must insert pauses in between utterances, and 
must use utterances within the constraints of the voice 
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system's stored vocabulary. This requires the user tc 
be very familiar with the vocabulary in use, not 
unlike knowing the letters of the alphabet. 

Speech input for machines is also of value in 
helping man cope with unusual circumstances. For example, 
it can be used in complete darkness, around obstacles, by 
the blind and other handicapped individuals, is unaffected 
by weightlessness, and only slightly affected by high 
acceleration and mechanical constraints. On the negative 
side, it is often sensitive tc dialect, and also susceptible 
to background noise and distortions. Additionally, a 
microphone must either be worn or held in close proximity to 
the speaker. And finally, a display or synthesized voice 
feedback may be necessary for tasks requiring data entry 
validation. 

The mobility possible with voice input is one of its 
greatest attributes. It enables operation of devices from a 
distance and from various orientations, permits simultaneous 
use of hands and eyes for other tasks, and can even permit 
the telephone to be used as a computer terminal. Some 
degree of privacy is lost, although users often operate in 
the laboratory at NPS inconspicuously running graphics 
displays and other command and control applications without 
bothering other nearby terminal operators. 

The key questions to keep in mind when considering 
the value of speech input are: "is there an application that 
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could be done more cost-effectively using vcice as a single 
or additional input modality? .. .and , " Is the current 
technology adequate to provide the quality, naturalness, and 
speed that the application of interest requires?" A brief 
loch at the military's efforts in voice technology may help 
the reader to further assess the value of speech technology 
for his own application. 

3 . Military Researcn and Applications 

Research supported by the Advanced Research Projects 
Agency (DARPA), which funds leading-edge technology, was a 
prime ingredient contributing to the development of voice 
technology. Eowever, a large number of military projects, 
such as the ARPA Speech Understanding Research, met with 
limited success as a great deal of work in acoustic- 
phonetics, speech perception, linguistics, and 
psychcac cus t ic equipment is still necessary to provide the 
foundation for ASR to approach human performance [Ref 12] . 

Most of the research in the military has turned to 
taking off-the-shelf isolated-word recognizers and adapting 
them to particular applications. Recognition studies in the 
military have teen done for applications in aircraft 
cockpits, tactical field data entry, military training 
systems, cartography, command and control of networks, 
wargames and graphics, keyword spotting of communications 
channels, emergency action message composition, and imagery 
interpretation tasks such as mensuration and reporting. The 
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applications most clcsely related tc this thesis are the 
cartography, command and control of displays, and imagery 
interpretation reporting. 

A significant amount of research was performed for 
the Defense Mapping Agency(DMA) by contractors under the 
program management of the Air .Force's Rome Air Development 
Center (RADC ) . The Defense Mapping Agency Aerospace Center 
(DMAAC) and the Defense Mapping Agency Aerospace and 
Hydrographic Center (DMAEC) produce large volumes of 
cartographic products for the military and other users. 
Research has been performed for such applications as voice 
data entry for the processing of Digital Landmass System 
(DIMS) data, preparation of Flight Information Publications 
(FLIPS) data, and ocean-depth measurements for digitized 
cartographic appl ications . In these applications analysts 
were performing tasks in an "eyes "busy, hands busy 
environment,” sometimes with stereo optics and or other 
special devices. Voice was shown experimentally to be 
faster, easier, and a less fatiguing mode of data entry than 
the more conventional modes used [Refs. 12, 14, end 15]. 
User acceptance and system support can he significant 
problems, as explained by DMAAC officials to the author 
during a recent visit to their facilities. 

The NPS is currently performing voice data entry 
research in the area of command and control applications. 
In a study by Focck, twenty-four command and control 
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students operated the ARPA network or ARPANET, a distributed 
network of computers in the U.S. and Europe, using voice and 
typing as a comparison between the two modes [Ref. 16]. 
Voice was significantly faster and more accurate for 
entering commands into the system. Additionally, students 
were given an secondary transcription task to perform while 
operating the ARPANET. The voice mode permitted 
substantially more data to be transcribed than the typing 
mode. On the other hand, ttcSorley recently demonstrated 
that voice was no faster than typing for entering commands 
into a vargame. This was due in part to the poor editing 
features of the game, but demonstrates that voice is not for 
everything [Ref. 1?] . 

In the area of imagery interpretation, interest in 
voice data entry is growing. RADC recently completed a 
study which evaluated a voice recognition system known as 
’’Talk and Type," built by Threshold Technology Inc., to 
study the application of voice data entry to the problem of 
imagery interpretation and intelligence report generation 
[Ref. 18]. The innovation by Threshold required the user to 
type the first letter of the word to be recognized. In this 
manner the voice system restricted the size of the 
vocabulary to be searched, thereby increasing recognition 
accuracy. Four varied tests were performed looking at small 
and large vo cabularies , and especially tasks where the 
subject was describing scenes the way an interpreter might 



38 



describe a bridge or a runway. The results showed the Talk 
and Type system tc be superior ever typing for unskilled 
typists. 

Soon the new ground station for the Tactical 
Reconnaissance-1 iTR-1) aircraft is expected tc be built tc 
provide exploitation and reporting support for the sensors 
aboard the U-2 derivative aircraft which is expected to 
provide N'RT reconnaissance support tc theater forces. 
According to the program manager, voice data entry is a 
serious consideration for inclusion into the program. 

D . SUMMARY 

The purpose of this thesis is to investigate the 
potential application of ASR technology to military imagery 
interpretation. The research responds to the need for 
rapid, concise, valid information for command and control 
of forces in peace and war. The functions of the imagery 
reporting systems include support for a variety of 
tasks, especially composing reports. The specific focus 
of the thesis is to examine the feasibility of 
writing order of battle reports using a large voice 
vocabulary of 255 words of USSR/Warsaw Pact military 
equipment names, editing commands, and alphanumerics . 

Several examples of modern operational and 
developmental imagery exploitation and reporting systems 
were briefly discussed which represent potential systems 
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for application of voice technology. Incorporation of ASH 
technology could result in improved capabilities in terms 
of speed, accuracy, and completeness of imagery 
reporting. ASR technology makes optimal use of the fact 
that speech is man's most natural input modality, 
while the limited speeds of interpreters typing may not 
optimize advanced reporting system capabilities. 

The advantages and disadvantages of speech were 
presented. Seme of the value of speech input awaits 
technological breakthroughs and may not be realized in this 
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continuous speech systems. Instead, the military is hard at 
work with applications efforts with limited-vocabulary, 
isolated-word, speaker-dependent voice recognition systems, 
proven to be reliable and accurate for the right 
applications, while monitoring and sometimes supporting work 
by private contractors, hopefully leading to practical 
continuous speech systems. 

The objective of this thesis is to support military 
applications research efforts aimed at comparing input 
modalities, and afford the intelligence community an 
independent data point regarding the overall evaluation 
of ASR. This research began independent of the related 
RADC research, and thus serves to underscore the 
appropriateness of voice data entry support to the task. 
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II. 



DESCRIPTION OF THE EXPERIMENT 



A. OBJECTIVES AN E CONSTRAINTS 

The objective of this experiment was to determine if 
state-of-the-art voice data entry equipment was feasible for 
reporting imagery-derived order of battle (03) intelligence 
using an interactive computer system. The experiment was 
designed to determine if there was any significant 
difference in speed, accuracy, efficiency, and subject 
attitudes regarding manual keyboard and voice data entry for 
this task. A large unclassified vocabulary cf 255 words 
containing alphanumeri cs , commands, and representative 
USSR/Warsaw Pact equipment names was selected for the 
reporting scenario (see Appendix A). Eased on recent 
research, voice data entry was expected to be faster, more 
accurate, and preferred by subjects over manual keyboard 
data entry [Ref. IS] . 

Accomplishment of this objective was constrained within 
the research facilities of the Naval Postgraduate School 
(NPS). In the interest cf time and money, the process of 
reporting was simulated to the maximum degree possible 
within the constraints of available subjects and labcratcry 
facilities. This simulation, though net ideal, afforded an 
effective, economical tool to accomplish this objective. 
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E. SUBJECTS 

Twenty subjects participated cn a volunteer basis. 
The group was composed of IB military officers, and 
two civilians. The military officers, representing the 
Army, Navy, Air Force, and Narines included 17 males and 1 
female; tneir grades ranged from Lieutenant to Commander 
and from Captain to Lieutenant Colonel. The civilians 
included an employee of the National Security Agency and 
a professor from the NFS Operations Research Department. 
The subjects' ages ranged from 28 to 45, with an average age 
of 33. 

Seventeen of the subjects were enrolled in the Command, 
Control, and Communications (C3) Curricula at NPS, while the 
other two students were from the Intelligence and Computer 
Science curriculas. The background of the subjects were 
quite varied: special warfare; ground combat; communications 
maintenance and staff; logistics staff; automatic data 
processing; training; intelligence; C3 research; language 
analysis; electronic warfare; Joint Chiefs of Staff? field 
artillery; destroyer group staff; combat development; C3 
training and operations? and tactical C3 flight operations. 

Nineteen of the subjects had experience with interactive 
computer systems at NPS. Eighteen of the subjects were 
experienced in use of the ARPANET, a network of computer 
systems available for use by the C3 Curricula and other 
researchers at NFS. The two subjects without ARPANET 
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experience were trained to tne level necessary to 
participate in the experiment with their contemporaries, 
since a computer on the ARPANET was chosen as tne host for 
the experiment. 

The subjects were, as a whole, familiar with speech 
recognition as many had either seen, used, or even studied 
automatic speech recognition. Eighteen subjects had seen a 
voice recognition system demonstrated; 12 subjects had used 
voice, primarily as subjects in one other experiment; and 11 
had studied voice for a term paper, thesis, or work at their 
previous duty station. 

C. EQUIPMENT 

1 . Voice Recognition System 

A Threshold Technology Inc. Model T600 voice 
recognition system was used to represent commercially 
available, state-of-the-art equipment. The T5 £0 is a 
speaker-dependent, isolated-word recognizer which 
automatically recognizes spoken words or phrases. These 
words or phrases are called utterances and must be in a 
range of 0. 1-2.0 seconds in duration and must be separated 
by very short pauses of 0.1 second or mere [Ref. 19]. 

The terminal consists of a threshold analog speech 
preprcces scr , an LSI-11 microcomputer and a digital RS-232 
input/output interface, an Ann Arbor large character 
display and operator console, an operator console/microphcne 
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preamplifier, and a tape cartridge unit. The speech 
preprocessor, microcomputer, and interfacing elements are 

contained in the main terminal unit which was table mounted. 

\ 

The remaining components, the display console, and tape were 
alsc table mounted and located with the main terminal (see 
Figure 7). A Shure SN-10 noise-cancelling microphone with 
headset was used for the voice input tc the preamplifier. 

The T620 combines analog and digital signal 

processing technology tc perform the recognition function. 
The energy from the spoken utterance is passed through 19 
bandpass filters spanning the speech spectrum. The presence 
or absence of each of 32 acoustic features is determined, 
and the appropriate feature information is extracted by a 
combination of analog and binary logic. The features are 
either primary features or phonetic-event features. Primary 
features describe the energy spectrum by measuring local 
maxima and the energy rate-of-change relative to the 
frequency of the voice signal. Phcnetic-event features 
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The T 600 has two primary nodes of operation: 
training mode, and recognition mode. In the training mode, 
the T602 extracts a time-normalized template for each given 
word. This template consists of two arrays referred to as 
the most significant tit (ftSB) and non extremum tit (NEB). 
The KSB indicates whether a particular feature has occurred 
and the NEE indicates the frequency of occurrence. These 
arrays combine to form the reference array (BAR) . When the 
T600 is in recognition mcde, the preprocessor functions as 
before: features are extracted, digitized, and time 
normalized. The resultant feature array (EAR) is correlated 
with the stored RARs in the current active vocabulary and 
the best correlation is selected as the recognized word. 

As previously mentioned, for each utterance 32 
acoustic features represented in binary form and their tire 
of occurrence are fed from the preprocessor to the 
microcomputer short-term memory. The pattern-matching 
algorithm subsequently compares these feature occurrence 
patterns to the stored reference patterns for the various 
vocabulary words and determine the "best fit" for a word 
decision. The FAR of a test word requires 512 bits of 
information (32 features mapped into 16 time segments). The 
RARs include 1224 bits per word because of the two part 
arrays . 

When the T602 recognizes a word in its vocabulary it 
will output a preprogrammed string of up to 16 characters 
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associated with the spoken worn. These output strings can 
be modified by the user at any time via his ASCII console, 
which may also be used instead of voice to interact with the 
host computer. Also associated with each word are training 
prompts which are strings of up to 12 ASCII characters 
displayed cn the CP.T terminal to notify the user of the word 
to be trained. The T600 used in this experiment required 10 
training utterances per word. 

Two types of errors can occur with the T600: 
misrecognition and rejection. Misrecognition errors are 
those where an output string is selected for output that 
does not match the utterance. When the system rejects the 
utterance as not part of the vocabulary it signals the 
operator with a "beep.” These two cases assume the word was 
in the vocabulary and properly trained. Other errors are 
called operator errors and arise from mispronunciation, 
using words not in the vocabulary, or a variety of other 
errors such as speaking too fast or slow. 

The T600 used had enough memory modules to maintain 
an active working vocabulary of 256 utterances. 
Vocabularies were input and output using the tape cartridge 
unit. The system reads and stores prompt and output strings 
and reference patterns from semiconductor random access 
memory onto rugged, high-quality magnetic tapes similar to 
cassette tape cartridges. A complete 256 word vocabulary 
may be recorded or loaded ir. a few minutes. 
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Two recognition nodes are available on the T 600: 
unbuffered and buffered. In unbuffered node, the T600 will 
send any output immediately to the host computer. No 
internal processing is performed on the output strings. 
Eowever, the buffered mode permits up to 126 utterance 
output strings to be sequentially stored in a T 600 buffer 
for subsequent output as a composite block of characters. 
An "erase function" may be used to delete the last 
utterance; an "interrupt" function sends a special user- 
defined string to the host and deletes the remainder of the 
buffer contents; a "cancel" function may be used to delete 
the buffer contents; and a "transmit" function will cause 
the TS00 to send the buffer contents to the host. The 
utterance assigned to these functions may be independent of 
their function name. 

2 . Tach i s to scope 

To provide a simulation of the light table 
and optics portion of the imagery interpreter's work 
environment, the G-1130 Harvard Tachi stoscope was 

selected from the man-machine laboratory facilities, 
(see Figure 6) The tachistoscope is an instrument that 
can present images of material presented on cards and, 
as modified in this experiment, a CRT display. The card 
images may be presented by a timer or changed at will by the 
subject using a button switch. Lighting may be regulated 
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end mult i-images overlayed. The three primary uses of the 
device are studies on learning, perception, and attention 
[Ref . 20] . 

However, in this experiment the tachi s toscope was 
used in the following manner. The viewport seen in Figure S 
simulates the optics through which an interpreter must get 
much of his/her data. The 4 " x 6” cards seen through it 
simulated the imagery the interpreter was tasked to analyze 
and report. The CRT presented three lines of data (40 
characters each) providing visual feedback for voice data 
entry. (Note: Rome Air Development Center has developed an 
eyepiece for a Rausch & Lomb stereoscope that displays 16 
characters of data while viewing the optics) thus the author 
assumed that more data could be displayed in the next few 
years to support such visual feedback, if required.) 

The tachis toscope viewport permitted the viewing of 
the scenario cards and the Ann Arbor CRT. The card image 
was centered above the three bottom lines of the large- 
character CRT. The CRT displayed the responses of the T603 
to the subject's utterances, thereby providing visual 
feedback to him/her performing the task. 
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Figure 9. Tachi s t oscope Viewport 




3 . Scenario Cards and Vocabulary 



The cards for the reporting scenario were used to 
sirulate frares of imagery. Because no imagery interpreters 
were available in large numbers for the experiment at NFS, 
the author created the cards with a to represent the 
equipment location and annotated the with the number 
and description of the equipment at the point. All subjects 
were provided with the same information, i.e. they were 
“perfect imagery interpreters" and any experience level was 
held constant. 

Figure 10 illustrates the format of two sample cards 
which had five to eight objects and an installation number. 
Bach card was divided into four quadrants to simplify and 
standardize the reporting process and scoring. 

Thirty-six cards were required for the experiment. 
Their content was governed by four criteria: realism, an 
even mix of ground, air, and naval terms, full use of the 
USSR/Warsaw Fact vocabulary selected for the experiment, end 
maintaining a balance in number of characters among sets of 
cards to be used in experimental trials. The cards used in 
the experiment are shown in reduced size in Appendix 3. The 
larger, actual size cards seen in Figure 10 were produced 
using large print on a Tektronix 4014 terminal and its 
associated thermal printer. 



52 



INSTALLATION 0298-T14217 



50 CONFIRMED ASU-85 

27 CONFIRMED ASU-57 
tt 



tt 
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19 PROBABLE MI-24.HIND HELICOPTERS 
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A IJSSR/Warsaw Pact vocabulary was used because of 
available unclassified source information in large quantity 
[Refs, cl, 22 , 23, and 24j . A full vocabulary cf 255 words 
was used containing the phonetic alphabet, numbers 0-23, 
administrative a lphanumeri cs , special symbols and control 
characters, and ground, air, and naval forces equipment 
vocabulary. Appendix A contains a complete listing of the 
vocabulary by number, training prompt, and output string. 

The vocabulary was not structured in terms of 
recognition sets. Rather, the T630 operated on the entire 
vocabulary each time an utterance was spoken. 

4 . Interactive Computer System: ARPANET 

To provide an interactive text editing environment 
for the reporting scenario, the facilities of the ARPANET 
were selected because of their reliability and also to 
demonstrate how reporting might be done over a distributed 
network of computers, rather than a local host system. The 
ARPANET, now managed by the Defense Communications Agency, 
was used by 16 cf the subjects during 5 quarters of their C2 
Curricula prior to the experiment. 

Two host computers were used: Information Sciences 
Institute Systems I and C (ISIS & ISIC), located in southern 
California. The experimental text editor (XED) , phctoscript 
(PHOTO), directory linking (TALK), file transfer protocol 
(FTP), and file archival (ARCHIVE) were the major programs 
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used to conduct and manage the experimental data and 
interactive computer environment. ISIC was the primary 
system used, because the ’’system load level" was generally 
lower thereby offering a more responsive system. The load 
level was checked during experimentation to assure a 
consistent response time was available to ail subjects. 
Both systems were supported by the TOPS-20 Operating System, 
on Digital Equipment Corporation (DEC) Model 20 Computers. 

These computers were linked to NFS terminals 
equipped with phone modems or acoustic couplers via 
the ARPANET distributed communications facilities. 
These facilities include a terminal interface processor 
(TIP) at N PS connecting school terminals with ISI via 
the ARPANET. The author gained access to the network 
via the TIP and selecting the network computer to be 
used. The ARPANET provided a myriad of facilities 
supporting the administration of the experiment. Figure 11 
is a map of the ARPANZT adapted from the ARPANET Information 
Brochure, 1979. 

CRT terminals and the T620 were attached to the 
ARPANET via 30£ bps acoustic couplers. A Lier-S iegler 
ADM CRT display was situated near the tachi s toscope to 
provide keyboard entry of the CB data obtained from the 
cards via the viewport (see Figure 12). The ADM terminal on 
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Attached tc 1SI Computer via the ARPANET 



the ARPANET was used to simulate the text editing facilities 
cf an imagery reporting system for the order cf tattle entry 
portion of the report. All keystroke entries into the 
terminal were copied by a typescript program during the 
experiment to provide a record of the subject's performance. 

A monitor station with a hardcopy Computer Eevices 
Miniterm and an Alanthus V-203 CRT display were used to 
record and observe the subject's actions, whether by voice 
or keyboard entry (see Figure 13). The Alanthus display, 
connected to the T600, provided the author with a copy cf 
the data being displayed to the operator via the Ann Arbor 
display used in the tachistosc ope viewport for visual 
feedback. This was essential for recording, recognition and 
rejection errors in the voice-buffered mode; such errors 
could not be analyzed from the hardcopy record if edited 
from the voice buffer prior to transmission of the buffer 
contents to the text editor. 

D. SUBJECT PREPARATION 

1 . T600 Vocabulary Training 

Prior to the experiment, subjects were individually 
trained in the use of the T600 to a level of knowledge and 
competence to allow them to operate it to train the large 
vocabulary of 255 words. Each subject was briefed on the 
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proper training of the Tfc 00, and received a demonstration 
and written instructions with the training (see Appendix C). 
Cnee the subject had demonstrated proficiency in operating 
and training the T600 , he/she was allowed tc proceed 
independently, with the author remaining nearby to answer 
questions and correct training pitfalls. Once training was 
complete, the subject tested the vocabulary by saying each 
word three times. Any words which were misrecognized or 
rejected mere than once were retrained until a good training 
pattern was established. Most retraining was required 
because the subject forgot hew the word was pronounced when 
initially trained. 

The training was normally accomplished in two 
sessions of approximately two hours each. Thus by the time 
the training was complete, the subject was very familiar 
with the T600. Approximately four hours was the average 
time each subject spent with the vocabulary prior to 
experimentation. The training patterns were stored on a 
cassette tape for each subject and retained by the author 
until experimentation. 
c . Typing Test 

A five minute typing test was given to each subject 
to group the subjects into 'FAST” and "SLOi*” typing ability 
groups; these groups were necessary for the experimental 
design. The typing test required only upper case letters 
and symbols (Appendix D) , as did the experiment. 



60 



The typing test was administered and scored 
similarly to the civil service test used to screen clerk- 
typist appli cants to determine their typing ability. 
The typing tests were scored for speed and accuracy. A 
raw score in words per minute was assigned according to 
the number of lines typed. Credit was given for all lines 
typed, including any portion of the last line started. 
The number of words per minute was based on an average word 
length of five characters. For each mispelled word, 0.2 
words per minute were subtracted from the raw score, 
taereby decreasing the final score to deduct for errors. For 
exanple, if a subject had a raw score of 40 wpm, but made £ 
typing errors, the final score would be 39 wpm. 

Subject typing speeds ranged uniformly from IV to 
58 words per minute, with an average speed of 43 words per 
minute. The SLOW typist scores ranged from 17 to 32 
with an average of 25; FAST typists scores ranged from 33 to 
58 with an average of 43. 

3 . Subjective Questionnaire and Data Sheet 

To assess the attitudes of each subject before and 
after experimentation regarding their assessment of voice 
data entry versus typed data entry, a 10 item subjective 
questionnaire was developed (see Appendix I). The 
questionnaire asked for the subject's opinions regarding the 
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voice and typing modes on concerns relating to usability 
such as speed, accuracy, flexibility, training, and other 
cri ter ia . 

Subjects also completed a short data sheet regarding 
age, previous job, background, next assignment, and voice 
experience. Appendix F contains the data sheet format. 

E. EXPERIMENTAL PROCEDURE 

As soon as the subject completed the vocabulary 
training, he/she was scheduled to perform the experiment 
which lasted between two and four hours, depending on the 
speed of the subject. The experiments were conducted in the 
NPS Man-Machine Lab at times most convenient to the subject, 
generally in the evening. 

The subject was briefed concerning the general purpose 
for the experiment and the three major parts of the 
experiment: typing mode, voice-unbuffered mode, and voice- 
buffered mode experimental conditions (see Appendix G). 
Each experimental condition consisted of a practice card and 
three trials. A Latin-Square determined the order of the 
experimental conditions such that a balance was maintained 
in the numbers of people starting each experimental mode. 
This balance was also maintained on the second and third 
experimental conditions for the subjects. In other words, 
care was taken that no experimental condition received an 



62 



advantage from always being first, second, or third. 
Subjects were assigned randomly tc the orderings. 

The subject's task for each aata entry mode was to write 
12 simplistic on-line imagery interpretation reports of the 
USSR/Warsaw Pact 05 obtained from the cards by looking 
through the viewport of the tacni stoscope . Four cards were 
included per trial for the three trials per mode. 

Recall the sample cards in Figure 12; they were used for 
typing (top) and voice (bottom) modes respectively, and 
differed slightly. Since some utterances were actually two 
or three words, (e.g. MIG-25 F0X3AT) and since the 
vocabulary of equipment names were so large, it was 
unrealistic to expect the subject to recall which ones were 
multiple words without greater familiarity with the 
vocabulary. A convention was adopted to link such words 
with an underscore symbol (_), such as MIG-25_F0XBAT , to 
remind the subject that tne name was to be said in a single 
utterance vice two or three utterances. The underscore was 
the only distinction between the cards for voice and typing 
modes . 

The report format is shown in Figure 14. The subject 
was required to report the installation number and C3 
location (*#) by quadrant in the order shown: UPPER LEFT, 
UPPER RIGHT, LOWER LEFT, LOWER RIGHT. Reports were to be 
separated by a blank line. 
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INSTALLATION 0298-T14217 
UPPER LEFT 

27 CONFIRMED ASU-57 AIRBORNE ASSAULT GUNS 
UPPER RIGHT 

£0 CONFIRMED ASU-86 AIRBORNE ASSAULT GUNS 
LOWER LEFT 

20 POSSIBLE M-20 EEAVY MORTARS 

48 CONFIRMED 240-MM BM-24 ROCKET LAUNCHERS 
LOWER RIGHT 

62 PROBABLE 122-MM D-30 FIELD HOWITZERS 

INSTALLATION 0199-V14197 
UPPER LEFT 

11 CONFIRMED MI-12 HOMER HELICOPTERS 
£ PROBABLE MI-6 HOOK HELICOPTERS 
UPPER RIGHT 

16 CONFIRMED MI-4 HOUND HELICOPTERS 
LOVER LEFT 

19 PROBABLE MI -24 HIND HELICOPTERS 
LOVER RIGHT 

21 CONFIRMED MI-10 HARKE HELICOPTERS 

Figure 14. OB Reporting Format Based on Caras in Figure 10 
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Subjects were allowed short breaks between trials and 
longer breaks between the entry modes as they moved for 
exanple from the typing portion to the voice-unbuffered 
portion or vice-versa. 

The number of characters per trial was balanced to a 
very high degree within 10-lb characters and 10-15 
utterances for all modes. The average number of keystrokes 
per trial for the typing mode was 1170. The average number 
of utterances per trial for the voice-unbuffered mode was 
220/trial, slightly less than the 228/trial for voice- 
buffered. These keystrokes and utterances did not count any 
editing keystrokes or utterances, but included all carriage 
returns required. To perform the 3 modes x 3 trials, a 
minimum of approximately 3510 keystrokes and 1344 utterances 
would be required, plus any editing. 

Prior to beginning each experimental condition the 
subject was briefed on the entry mode, reminded of the 
editing features available (delete character, delete word, 
delete line, and repeat line), and allowed to practice the 
entry mode by writing a report for a practice card. 

The experimenter monitored the entire experiment at the 
station illustrated in Figure 13. The elapsed time to 
complete each trial was measured using a digital stopwatch 
and recorded. The Miniterm provided a typescript for 
analysis of the reports for missing or extra information, 
resulting from typing or voice recognition errors. Zxtra 
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typing keystrokes or voice utterances used for editing out 
errors were noted for subsequent analysis for an efficiency 
measurement. The CRT display was used for the unbuffered 
voice mode to record the misrecognitions and rejects since 
they did not appear on the typescript if they were edited 
prior to buffer transmission . 

At the conclusion of the experiment the subject 
completed the subjective questionnaire again. The subject 
was asked not to discuss the experiment with others. 



F. DEPENDENT VARIABLES 

The following variables were recorded or calculated in 
per cent for each trial: 

NCC 

Report Accuracy (RA)= X 100 

NCC + OS + CE 

where NCC: Number of Characters Correct 

01: Omission Errors/missing data 

CE: Commission Errors/extra data 



NCE/U 

Mode Efficiency (MS) = X 100 

NCK/U + EK/U + SBK/U 

where NCK/U: Number of Correct 

Keys trokes /Ut terances (Typing /Voice ) 
EK/U: Error Key strokes/Ut terances 

EDK/U: Editing Keystrokes/ Utterances 

used to recover errors 
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NCR 

Recognition Accuracy (RA) = X 122 

NCR + NM 

where NCR: Number of Correct Recognitions 

NM: Number of Misreccgni tions 

NCR 

Recognition Accuracy (RAR) = X 100 

with Rejects NCR + NM + NR 

where NCR: Number of Correct Recognitions 

NM : Number of Misrecognitions 

NR: Number of Rejects 

Perhaps the most important variable was the time it took 
for a subject tc complete the trials in the experiment. 
Close behind time is accuracy, since reports must be valid 
in addition to timely. Thus it is important to look at 
report output in terms of accuracy as a system, product. 
Frequently experimenters examine the errors made with voice 
and typing and report the results as percentage of error. 
However in this experiment the final test is in the report 
produced ... is it accurate? Next, how efficient is the 
data entry mode? This is also a useful statistic for 
judging the merits of each system. Accuracy and efficiency 
were basic measures of the total system capability, i ,e . the 
man and the machine. Recognition accuracy was a measure of 
T500 performance alone, with operator errors such as 
mispronunciation removed. Two recognition accuracy measures 
were examined, but the first is considered most appropriate 
in this experiment since the T600 did not output incorrect 
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data but beeped when it rejected what should have been a 
valid vocabulary utterance. 

G- . HYPOTHESIS 

The following hypotheses were tested: 

1 . Hypotheses Regarding TIME 



a . E<> : 


There is nc difference in TIME to 
complete reports between FAST 
and SLOW typists. 


H, : 


Eo false. 


b. H 0 : 


There is no difference in TIME to 
complete reports among the 
THREE DATA ENTRY MODES. 


fi, : 


Ho false. 


c . Ho : 


There is no difference in TIME to 
complete reports among the 
THREE TRIALS . 


H/ : 


Ho false. 



2 . Hypotheses Regarding ACCURACY 



a . Ho : 


There is no difference in ACCURACY of 
reports between FAST and SLOW typists. 


H/ : 


Ho false. 


b. Ho : 


There is no difference in ACCURACY of 
reports among the THREE DATA ENTRY MODES. 


K, : 


Ho false. 
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o 

PI 

o 


: There is no difference in ACCURACY of 

reports among the THREE TRIALS. 


K/ 


: Hq false. 



3 . Hypotheses Regarding EFFICIENCY 

■ — ■■■ ■■ ■ ■■■ .i i ... ■ 



a . Ho 


: There is no difference in EFFICIENCY 

between FAST and SLOW typists. 


5/ 


: Ho false. 


b. 


: There is no difference in EFFICIENCY 

among the THREE DATA ENTRY MODES. 


H/ 


: Ho false. 


c • - ^ 


: There is no difference in EFFICIENCY 

among the THREE TRIALS. 


E, 


: Eo false. 



4. Hypotheses Regarding T6gg RECOGNITION ACCURACY 





WITHOUT REJECTS 


a . Ho 


: There is no difference in RECOGNITION 

ACCURACY between FAST and SLOW typists 


Ej 


: Ho false. 


b. Ho 


: There is no difference in RECOGNITION 

ACCURACY among the TWO VOICE MODES. 


E / 


: H 0 false. 


c . Eo 


: There is no difference in RECOGNITION 

ACCURACY among the THREE TRIALS. 


E, 


: Eo false. 
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5. Hypotheses Regarding T 600 RECOGNITION ACCURACY 





WITH REJECTS 


a . Ho : 


There is no difference in RECOGNITION 
ACCURACY WITH REJECTS between FAST and 
SLOW typists. 


E, : 


H 0 false. 


b . Ho '• 


There is no difference in RECOGNITION 
ACCURACY WITH REJECTS amon* the TWO 
VOICE MODES. 




E 0 false. 


c . Ho : 


There is no difference in RECOGNITION 
ACCURACY WITH REJECTS among the THREE 
TRIALS . 


Hi : 


Ho false. 



5. Hypothesis Regarding SUBJECT ATTITUDES 



Ko : 


There is no difference in SUBJECT 
ATTITUDES regarding a preference for 
VOICE DATA ENTRY over TYPED DATA 
ENTRY after the experiment. 


H, : 


H 0 false. 



H. EXPERIMENTAL DESIGN 

The conceptual design for the experiment is illustrated 
in Figure 15. This is a three-factor nested design with 
repeated measures over trials. The subject is nested within 
only one typing ability condition. Recall that one-third of 
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FAST 

TYPING 

ABILITY 

(TA) 

SLOW 



Subject 1 



Subject 10 



Subject 11 



Subject 20 



TYPING VOICE VOICE 

UNBUFFERED BUFFERED 

DATA ENTRY MODE (DEM) 




TRIAL (T) 



Figure 15. Conceptual Design of the Experiment 
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the subjects started typing first; another third started 
voice-unbuffered first, and another third started 
voice-buffered first. 

An analysis of variance procedure was selected to test 
the hypotheses for reporting tines, accuracy, and 
efficiency, and T600 recognition rates. A significance 
level of ac = 3.0c was used as the experimental threshold. A 
sign test was chosen to evaluate the subjective 
Questionnaire results at a significance level of x= 0.10. 

I. RESULTS 

1 . Results for Reporting Tine 

The results for reporting time were the most 
significant, with an analysis of variance (ANOVA) indicating 
SIGNIFICANT DIFFERENCES in the DATA ENTRY ^ODES and TRIALS 
^p < .0005). The mean reporting tines in Table I show the 
average tine in minutes to complete each of the reporting 
trials for each of the three data entry nodes. Table II 
displays the results of the ANOVA for reporting time, and 
Figures 16 and 17 illustrate the significant differences. 

On the average, voice-unbuffered was 41% faster and 
voice-buffered was 56% faster than typed data entry. Thus 
voice data entry, averaging the two modes, was 50% faster 
overall than typing. Voice data entry was faster because the 
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subject was able tc simultaneously receive information 
through the viewport while composing the report. The 
feedback received on the monitor enabled immediate 
confirmation of the T600 response to his/her utterances. 
The typist, in the conventional reporting mode, was forced 
to return often to the viewport to get additional items of 
information, since there was too much to memorize. The 
illustrated differences may be seen in Figure 16. 

Learning over trials is apparent in all three data 
entry modes. Figure 17 illustrates the differences in time 
to complete the scenario by trials. No significant 
differences were noted between typing abilities. All 
subjects adapted to the reporting task well. The voice- 
buffered mode was the most natural for subjects to use, 
since they could simply speak the report into the system, 
and make corrections most easily. Thus they learned to use 
it quickly, and improved slightly thereafter. The voice- 
unbuffered and typing modes, with more room for improvement, 
showed more learning as the subjects adapted to the 
reporting scenario. 

No significant difference was apparent between fast 
and slow typists for this experiment. This was primarily 
because the amount of information that the subject could get 
from the tachis to scope was limited to the amount he/she 
could memorize when moving back and forth to the manual 
keyboa rd . 
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ABLE I 



MEAN REPORTING TIME (MINUTES) 







TYPING 


VOICE 

UNBUFFERED 


VOICE 

BUFFERED 


FAST TYPISTS 


Trial 1 




16.2 


11.6 


10.5 


Trial Z 




13.6 


10.5 


10 .1 


Trial 3 




13.2 


9.6 


9.1 


All Trials 




14.3 


10.6 


9.9 


SLOW TYPISTS 


Trial 1 




IS .0 


12.7 


10.0 


Trial 2 




16.5 


10 .6 


9.8 


Trial 3 




15.6 


10.5 


9 .2 


All Trials 




16.7 


11.3 


9.7 


ALL SUBJECTS 


Trial 1 




17.1 


12.2 


10 .3 


Trial 2 




15.1 


10.7 


10.0 


Trial 3 




14.4 


10.1 


9 .2 


All Trials 




15.5 


11.0 


9 .8 


For 


the 


foil owing 


analysis cf 


variance several 


abbeviat ions 


are 


used for 


the sake of 


brevity. Their 



meaning is expanded below: 



SS: Sum of Squares 
af : degrees of freedom 
MS: Mean Square 
F : F Ratio 

p: significance level 
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TAELE II 



ANALYSIS CF VARIANCE FCR REPORTING TIME (SECONDS) 



SOURCE 


SS 


df 


MS 


F 


P 


BETWEEN SUBJECTS 


: 3,568,801.60 


19 








Typing Ability 
(TA) 


149,472.05 


1 


149,492.05 


0 .78 


NS 


Error 


3,439,329.61 


18 


191 ,073.67 






WITHIN SUBJECTS: 


6,588,801.20 


160 








Late Entry 
rede (DEM) 


3,969,141.26 


2 


1 ,984,570.64 


61 .61 




TA X DEM 


167,215.63 


2 


93,607.62 


2.91 


NS 


Error ( 1 ) 


1,159,579.54 


36 


32,210.54 






Trials (Tr) 


424,668 .41 


2 


212,444.21 


33.22 




TA x Tr 


2766.70 


2 


1 ,383.35 


0.22 


NS 


Error (2 ) 


230,255.50 


36 


6,395.99 






DEM x Tr 


66,396.02 


4 


16,599.01 


2.28 


NS 


TA x DEM x Tr 


17,872.27 


4 


4,466.07 


0.61 


NS 


Error (3 ) 


525,207 .79 


72 


7,294.55 






TOTAL 


10,172,124.80 


179 









** p < 0.0005 

f NS: NOT SIGNIFICANT for p < 0.05 ] 
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MEAN TIME 
( rrinutes ) 



1 ? + 




9 



TYPING VCI CE-UN BUFFER ER VOI CE-BUFFERZR 

RATA ENTRY MORES (REM) 

Figure 16 . Mean Reporting Time by Rata Entry Mode 
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MEAN TIME 
( minutes ) 



19 + 



I 

! 

IB + 

i 



! TYPING 



17 + MODE 



16 + 



16 



i 

+ 

i 



14 



i 

! 

+ 

I 

I 

I 

I 



! UNBUFFERED 



12 + MODE 




Figure 17. Mean Reporting Tirre by Trial 
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2 . Results for Reporting Accuracy 



The results for reporting accuracy are shown in 
Tables III and IV. The analysis of variance for the 

arcsi n-transf ormed efficiency data revealed NO SIGNIFICANT 
DIFFERENCES in AIL CONDITIONS investigated. The subjects, 
whether fast or slow typists, did near perfect reporting in 
each mode, over all trials. The reporting accuracy was 
expected to be high, but exceeded the author's expectations. 
An average of 99.5% accuracy was achieved for the 
experiment . 

Subjects were told to go as fast as possible, while 
maintaining accurate reporting. I^ost errors were errors of 
omission, where a letter or worn was missing from a report. 
Even greater speeds could be expected, especially frcm 
voice, in situations where more errors could be tolerated. 
But in the case of imagery reporting, accuracy was deemed 
essential, even though operationally reports are normally 
edited before being sent cut to the agencies. 

TABLE III 

MEAN REPORTING ACCURACY (%) 

VOICE VOICE 





TYPING 


UNBUFFERED 


BUFFERED 


FAST TYPISTS 


99.8 


99.6 


99.7 


SLOW TYPISTS 


99.2 


99.4 


99.6 


ALL SUBJECTS 


99.5 


99.5 


99.6 
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TABLE IV 



ANALYSIS OF VARIANCE 

FOR ARCS I N-TR AN S FORMED REPORTING ACCURACY 
Y = 2 * ARCSIN [SQRT( ACCURACY %)] 



SOURCE 


SS 


df 


MS 


Y 


P 


BETWEEN SUBJECTS: 


3 .786 


19 








Tyring Ability 
(TA) 


0 .004 


1 


0.004 


0 .02 


NS 


Error 


3.784 


IS 


0.210 






WITHIN SUBJECTS: 


24.030 


160 








Lata Entry 
Mode (DEM) 


0.346 


2 


0.173 


1 .16 


NS 


TA x DEM 


0.407 


2 


0.204 


1 .40 


NS 


Error ( 1 ) 


£.262 


36 


0.146 






Trials (Tr) 


0.352 


2 


0.176 


1.18 


NS 


TA x Tr 


0.202 


r 

c 


0.101 


0.68 


NS 


Error (2 ) 


5.362 


36 


0.149 






DEM x Tr 


0.395 


4 


0.099 


0 .64 


NS 


TA x DEM x Tr 


0.326 


4 


0.082 


0.53 


NS 


Error (3 ) 


11.078 


72 


0.154 






TOTAL 


27 .518 


179 








[ NS: NOT SIGNIFICANT for p 
Note: Arcsin transform above normalizes 


< 0.05 ] 
the per 


cent data 


• 
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Results for Reporting Efficiency 



The results for reporting efficiency are shewn in 
Tables V and VI. The analysis of variance indicated 
SIGNIFICANT DIFFERENCES between the DATA ENTRY MODES . 
Figure 16 shows the differences with typing being the most 
efficient at 95%, voice-buffered next with an efficiency of 
65%, and finally voice-unbuffered with an efficiency of 60%. 

The author attributes the efficiency difference, in 
part, to the level of experience with the mode. The reader 
may recall that the subjects had, in general, extensive 
keyboard experience during five quarters at NPS . In 
comparison with typing, the subjects had very little 
experience with voice. It is expected that if subjects were 
more skilled and efficient in the use of voice data entry, 
the time advantages reported earlier would be even more 
dramatic. Voice-buffered was more efficient than voice- 
unbuffered because the subject could edit out an entire 
incorrect utterance, vice deleting it by voice a word at a 
time in the unbuffered mode. 
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TABLE V 





MEAN REPORTING 
TYPING 


EFFICIENCY (%) 
VOICE 

UNBUFFERED 


VOICE 

BUFFERED 


5 AST TYPISTS 


Trial 1 


93.6 


77.2 


63.5 


Trial 2 


95.1 


80.5 


85.7 


Trial 3 


93. S 


61.6 


83 .3 


All Trials 


94.2 


79.8 


84.2 


SLOW TYPISTS 


Trial 1 


94.4 


80.0 


66 .3 


Trial 2 


95.8 


64.4 


64.4 


Trial 3 


96.7 


76.9 


66 .4 


All Trials 


95.6 


80.4 


86.4 


ALL SUBJECTS 


Trial 1 


94.0 


78.6 


84.9 


Trial 2 


95.4 


62.5 


85.0 


Trial 3 


95.3 


79.3 


65.8 


All Trials 


94.9 


60.1 


85 .2 
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TA3LE VI 



ANALYSIS Oi" VARIANCE 

FOR ARCS IN-TRANSFORMED REPORTING EFFICIENCY 
Y = 2 * ARCSIN [SQRT (EFFICIENCY %)] 



SOURCE 


SS 


df 


MS 


y 


P 


BETWEEN SUBJECTS: 


3.059 


19 








Typing Ability 
(TA) 


0.134 


i 


0.134 


0 .82 


NS 


Error 


2.925 


18 


0.163 






WITHIN SUBJECTS: 


15 .689 


150 








Date Entry 
Mode (BE*) 


7.102 


2 


3.551 


44 .95 




TA x DEM 


0.023 


2 


0.011 


0.14 


NS 


Error ( 1 ) 


2.860 


36 


0.079 






Trials (Tr) 


0.170 


2 


0.085 


3.54 


NS 


TA i Tr 


0 .020 


2 


0.010 


0 .42 


NS 


Error(2 ) 


0.860 


36 


0.860 






DEM x Tr 


0.167 


4 


0.042 


1 .40 


MS 


TA x DEM x Tr 


0.301 


4 


0.075 


2.50 


NS 


Error (3 ) 


2.186 


72 


0.030 






TOTAL 


16.746 


179 










** p < 


0.001 









[ NS: NOT SIGNIFICANT fcr ? < 0.05 ] 
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V EAN EFFICIENCY 
102 % + 



95 % + 



92 % + 



85 % + 



80 % + 



\ 




( *-// o 



+ 



ii i ; 

ii i \ 

^ 2 % 

TYPING VOICE-UNBUFFERED VOICE-BUFFERED 

DATA ENTRY MODES (DEM) 

Figure IS. Mean Reporting Efficiency ty Data Entry Mode 
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4 . 



Results for T600 Recognition Accuracy 



The results fcr the T603 Recognition Accuracy are 
shown in Tables VII, VIII, IX, and X. Analysis of variance 
of the results revealed NO SIGNIFICANT DIFFERENCES fcr ALL 
CONDITIONS considered. Thus the T600 recognized all 
subjects equally well during all trials of the experiment. 
The T6Z0 recognition accuracy was S?.0% overall if an error 
is defined as a mi sreccgnit ion only. If rejects are 
included, the recognition accuracy drops to 95.5% as an 
overall average. 

These results are based on an average of 1519 
utterances per subject giving 30,380 utterances for the 
entire experiment using 22 subjects. This number includes 
the utterances required, plus misrecogni tions and reject 
utterances, and finally the editing utterances used to 
correct errors. A list of nisrecognitions and rejects is 
contained in Appendix H. 

The author had expected the recognition 
accuracy to get wcrse in later trials from fatigue or 
frustration, since the experiment was two tc four hours in 
length. One procedure that may have helped was to 
allow subjects to, upon their request, retrain troublesome 
words during the course of the experiment. The time tc 
retrain was counted against the trial time to account for 
realistic retraining that would take place on the jot. 
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TaBLE vii 

MAN T6ze RECOGNITION ACCURACY (%) 
WITHOUT REJECTS 







VOICE 

UNBUFFERED 


VOICE 

BUFFERED 


FAST 


TYPISTS 


97.0 


97.1 


SLOW 


TYPISTS 


97. e 


96.9 


ALL 


SUBJECTS 


97.0 


97.0 






TABLE 


VIII 






MEAN T600 RECOGNITION ACCURACY 






WITH 


REJECTS 






VOICE 

UNBUFFERED 


VOICE 

BUFFERED 


FAST 


TYPISTS 


95.6 


95.4 


SLOW 


TYPISTS 


95.2 


95.4 


ALL 


SUBJECTS 


95.5 


95.4 



BE 



TABLE IX 



ANALYSIS 0? VARIANCE 

ARCS IN-TRANSFORMED T600 RECOGNITION ACCURACY 

WITHOUT REJECTS 

Y = 2 * ARCSIN [SORT ( ACCURACY %)] 



SOURCE 


SS 


df 


MS 


F 


P 


BETWEEN SUBJECTS: 


0.864 


19 








Typing Ability 
(TA) 


0.001 


1 


0.001 


0 .02 


NS 


3rr cr 


0.963 


18 


0.046 






WITHIN SUBJECTS: 


1.033 


100 








Data Entry 
Mode (DEM) 


0.000 


' 1 


0.000 


0 .00 


NS 


TA x DEM 


0 . 009 


1 


0.009 


0.69 


NS 


Error ( 1 ) 


0.231 


16 


0.013 






Trials (Tr) 


0 .009 


2 


0.005 


0.63 


NS 


TA x Tr 


0.03? 


2 


0.019 


2.38 


NS 


Error(2) 


0.261 


36 


0.008 






DEM. x Tr 


0.053 


2 


0.02? 


2.45 


NS 


TA x DEM x Tr 


0.032 


2 


0.016 


1 .45 


NS 


Srror(3 ) 


0.381 


36 


0.011 






TOTAL 


1.S97 


119 









[ NS: NOT SIGNIFICANT for p < 0.05 ] 
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TABLE X 



ANALYSIS C? VARIANCE 

ARCS IN-TRANSFORMED RECOGNITION ACCURACY 

WITH REJECTS 

Y = 2 * ARCSIN [SORT (ACCURACY %)] 



SOURCE 


SS 


df 


MS 




P 


BETWEEN SUBJECTS: 


0 .926 


19 








Tyoin^ Ability 
( TA ) 


0.000 


1 


0.000 


0.00 


NS 


Error 


0.926 


18 


0.051 






WITHIN SUEJECTS: 


1.106 


100 








Data Entry 
Mode (DEM) 


0.000 


1 


0.000 


0.00 


NS 


TA x DEM 


0.004: 


1 


0.004 


0 .33 


NS 


Error ( 1 ) 


0.224: 


18 


0.012 






Trials (Tr) 


0.001 


2 


0 . 000 


0 .00 


NS 


TA x Tr 


0.034 


2 


0.017 


2 .43 


NS 


Error ( 2 ) 


0.258 


36 


0.007 






DEM x Tr 


0 .046 


2 


0.023 


1.64 


NS 


TA x DEM x Tr 


0.018 


2 


0.009 


0.64 


NS 


Error (3 ) 


0.521 


36 


0.014 






TOTAL 


1.977 


119 








[ NS : 


NOT SIGNIFICAN 


T for 


p < 0.05 ] 
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During the experiment the author observed that 
subjects occasionally tecame frustrated when the 
T602 was misrecognizing their u t te ranees . This 
frustration appeared to, at tirres, generate a lack of 
confidence in the T600, along with a change in the 
overall pitch, rate, and inflection of the voice. 
The frustration seemed more prevalent in the 
unbuffered than the buffered mode, for this reason, the 
T600 buffered mode was expected to have a better 
recognition rate, since it was faster and somewhat easier 
to use. However the results indicate there is no 
difference in the recognition rate. One explanation is that 
subjects went faster in the buffered mode since they could 
correct the mi sr ecogni ti ens more easily. With the 
consequence of a misreccgnition reduced, they were less 
afraid to make mistakes. 

5 . Results for Subject Attitudes 

The scores from the subjective questionnaire given 
before and after the experiment were tested for any general 
change in opinion regarding voice versus typed data entry. 
These scores were evaluated using a two-tailed nonparamet ric 
sign test, az = 0.10. A significant snift in favor of voice 
data entry over typing occured for half of the criteria 
covered by the questionnaire. No significant shifts toward 
typing resulted from the analysis. Appendix I contains the 
results of the pre/post questionnaire. 
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S ummar i z ing the results, subjects either were 
neutral or favored voice before and after the experiment . 
After the experiment, they preferred voice even more fcr 
ease of use, speed, flexibility, intermittent use, and 
finally ease of learning to use as an input modality. They 
continued to believe that voice was a more accurate, 
sustaining, relaxed man-machine interface for on-line 
reporting of critical, tine-sensitive information such as 
intelligence obtained in a high-pressure work environment. 

The subjects' positive attitudes about voice arise 
from their fresh experience and observations of speech 
recognition equipment in the C3 Lab at NPS, where it is used 
with the Wargame Effectiveness Simulator (WES) with graphics 
and other ARPANET and laboratory facilities to demonstrate 
its potential for command, control, and communications 
applications . 
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III. DISCUSSION 



A. CENTRAL 

This thesis investigated tne potential application of 
automatic speech recognition technology to military imagery 
interpretation reporting. Only the order of battle portion 
of reporting was investigated because of limited time and 
resources. The overall results of the experiment are 
supportive of the application of voice data entry for 
imagery interpretation reporting systems. Voice-buffered 
mode was 5£% faster than typing, while voice-unbuffered was 
41% faster. On the average, voice was E0% faster than 
typing . 

Voice was faster because it allowed the operator to view 
the image while reporting. This experiment modeled 
conventional imagery reporting systems where a light table 
is located next to a computer console. The operator 
must move back and forth between the light table and the 
console, or two operators work together, with one 
interpreting the imagery, and the other writing the report 
via the console. For these situations, it appears voice 
data entry would significantly improve reporting speeds 
and/or require only one person per station to perform the 
task. For newer systems with the keyboard and function keys 
built into a computer console with a light table or digital 
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display, voice nay not have as significant an irrpact for 
improving reporting speeds. 

Both voice and typing were very accurate for 
the experimental task, with no significant difference 
between modes and an overall accuracy of 99.5%. It is 
interesting - to note these speeds and accuracies were 
obtained even though subjects were less efficient with 
either mode of voice. Voice-unbuffered had 80.1% 
efficiency, voice-buffered had 85% efficiency, and 
typing had 95% efficiency. These results were all 
attained at a significance level of x = 0.05 or better. 

In terms of recognition accuracy, the results were 
better tnan the author expected. Poorer results were 
expected because short phrases consisting of several 
utterances were used rather than simple one or two utterance 
commands. It was anticipated that subjects would run words 
together more than they actually did, and it was also 
anticipated that the T600 would have mere trouble with 
similar sounding terms such as MIG-25 FOX3AT and MIG-25R 
JOXBAT ... or CHARLIZ I CLASS and CHARI IF II CLASS. Though 
the T500 did misrecognize such words at times, subjects 
quickly adapted to the situation, emphasizing the portion of 
the utterance that was unique, thereby achieving 
better results. The 97% overall recognition accuracy 
would likely improve with practice and increased usage. 
Additionally, new high-speed recognition systems, like 
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Threshold's QUICkTALK (Trademark), require a much shorter 
pause between utterances, thus permitting the operator to 
speak faster. CU1CKTALL is advertised to reach speeds of 
182 vords-per-minute , and 99 % accuracy for moderately 
trained speakers. Vocabulary structuring may also be 
performed which allows the system to search only a subset of 
the vocabulary, thus increasing the speed and accuracy of 
recognition. This system, as advertised, has twice the 
speed of the T600 used in the experiment. 

Subjects tendea to prefer voice before and after the 
experiment (even more). Zcr the vast majority of subjects, 
this was the first use of voice continuously for an extended 
period of time. Even though it did net meet some of their 
more lofty expectations, they continued to give voice the 
edge in the subjective questionnaire, and actually 
strengthed their opinions toward it on several criteria. 

Thus this experiment, though outside an operational 
setting, supports further research and possible applications 
of ASR for imagery interpretation reporting systems, and 
perhaps ether similar intelligence and tactical commend end 
control data systems. The results are certainly not new, 
but add credence to the related results achieved by EAEC, 
NFS, and others. 

Use of the ARPANET facilities in this 
experiment demonstrated, to a limited degree, that 
reporting can be performed without the benefit of a 
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local host computer. This may be very beneficial in the 
future if department of defense organizations vent to 
remctely query cr update a ccmmcn data base. 

E . RECOMMENDATIONS 
1 . Res earch 

The time is perhaps ripe for the military to perform 
some research using voice data entry as a keyboard assist 
for one or mere of the current imagery reporting systems, 
such as TIPI IIS, MASSES, CATIS, PACER, AIRES, and others. 
Ey beginning now to look at the use of voice for these 
systems, the intelligence community may be able to identify 
the specific questions needing to be addressed to most fully 
adapt vcice as an input mcdality. In the next five or ten 
years, the outlook for "matter-of-fact" use of voice is 
good. By studying the problems associated with training, 
user acceptance, physical interfacing, vocabulary size, 
vocabulary data-base maintenance, response times, and other 
areas now, voice will be more easily applied later. 

Additionally, vcice input may be applied to other 
tasks associated with the other intelligence disciplines 
using interactive computer-controlled devices. Command 
center applications are also receiving increased at tent ion 
as natural language query systems coupled with graphics 
displays commanded by vcice are now a reality in terms cf 
advanced applications technology. 
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All new imagery exploitation systems being developed 
or modified snculd fully consider the benefits of voice 
recognition technology. Considering the three to eight years 
it takes to develop a new system, it is highly likely that 
by the time it is fielded, significantly more voice 
capabilities will be available. Special consideration 
should be given to not only to how it might aid interpreters 
in the reporting process, but also how they might be able to 
use it to enhance, manipulate, annotate, and otherwise 
modify digital softcopy imagery on systems such as Compass 
Preview . 

2 . App lications 

Practical applications using voice data entry on a 
large scale will require a significant amount of work. It 
must also be proven that while voice may be as fast or 
faster than typing that the time differential achieved 
contributes commensurately with the additional cost of such 
new technology. Careful attention must be paid to involving 
the users, since they will ultimately "sell" the system, 
even though proven in the lab. 

The author recommends a small application first with 
a few of the best interpreters who know the imagery 
system well, and are ambivalent regarding voice data entry. 
By allowing them to use voice on a daily basis, they can 
develop the in-house expertise at the level needed to apply 
it on a large scale later. ..or they may be able to assess 
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that it just won't work for that particular application. 

The military is fortunate, having excellent research 
people involved with voice technology. RADC and NFS are 
just two military institutions able to provide consultation 
and assistance. 

C. CONCLUSIONS 

Since 1972, automatic speech recognition has 



proven to 


be 


valuable for 


a number 


of limited 


applications . 


The 


future for the 


technology 


is bright. 



The author concludes voice is not only feasible, but 
desirable as a means toward the best imagery 
interpretation reporting possible. It is not so much a 
question of whether voice can be used, but rather ... 
how can it be used?... how extensively can it be used?... and 
hew cost-effective will it be? 
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APPENDIX A 



USSR/WARSAW PACT ORDER Of BATTLE (OB; VOCAEULARY 



INSTRUCTIONS: TRAIN THE WORDS IN THE GIVEN SEQUENCE, USING 
THE GIVEN PROMPT . WORD NUMBERS MARKED WITH AN ASTERISK MAY 
BE TRAINED WITH THE GIVEN PROMPT OR YOU MAY USE YOUR OWN. 
(THESE WORDS WILL BE USED EOR TEXT EDITING, AND THUS SHOULD 
BE FAMILIAR, EASY TO REMEMBER) **** BE SURE TO WRITE IN THE 
ONE THAT YOU USE ON TEE VOCAEULARY LISTING SO THAT YOU MAY 
HAVE IT FOR FUTURE REFERENCE. **** 



WORD 


PROMPT 


OUTPUT 


2 


ZERO 


0 


1 


ONE 


1 


2 


TWO 


c 


3 


THREE 


3 


4 


FOUR 


4 


P 


FIVE 




5 


S IX 


6 


? 


SEVEN 


7 


6 


EIGHT 


8 


9 


NINE 


9 


10 


ALPHA 


A 


11 


ERAVO 


B 


12 


CHARLIE 


C 


13 


DELTA 


D 


14 


ECHO 


E 


15 


FOXTROT 


A 


16 


GOLF 


G 


17 


HOTEL 


H 


18 


INDIA 


I 


19 


JULIET 


J 


20 


KILO 


X 


21 


LIMA 


L 


22 


MIKE 


M 


23 


NOVEMBER 


N 


24 


OSCAR 


0 


25 


POPPA 


P 


26 


QUEBEC 


Q 


27 


ROMEO 


R 


28 


SIERRA 


S 


29 


TANGO 


T 


30 


UNIFORM 


U 


31 


VICTOR 


V 


32 


WHISKEY 


w 


33 


XRAY 


X 
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34 


YANKEE 


Y 


35 


ZULU 


Z 


36 


POSS ISLE 


POSSIBLE 


37 


PROBABLE 


PROBABLE 


38 


CONFIRMED 


.CONFIRMED, 


39 


DASH 


- 


4Z* 


ERAS Z 


BKSP <CTRL A> 


41 


C-0 OR CARRIAGE RETURN 


^CARRIAGE RETUR 


42 


SLASH 


/ 


43* 


KILL WORD 


<C TRL W> 


44* 


KILL LINE 


4CTRL X> 


45* 


REPEAT LINE 


<CTRL R> 


46 


SPACE 


<S PACE CHARACTE 


47 


TEN 


10 


48 


INSTALLATION 


INSTALLATION 


49 


ELEVEN 


11 


50 


UPPER LEFT 


UPPER LEFT 


51 


TANKS 


TANKS 


52 


LIGHT 


LIGHT 


c •? 


MEDIUM 


MEDIUM 


54 


HEAVY 


HEAVY 


55 


T72 


T-72 


56 


Tc2 


T'~62_ 


57 


T54/55 


T— 54/ 55 


58 


T10 


T-ie 


59 


T34/65 


T-34/85 


60 


TWELVE 


12 


61 


PT76 


PT -76 


62 


AMPEIBEOUS 


AMPHIBEOUS 


63 


UPPER RIGHT 


UPPER RIGHT 


64 


A?C 


APC 


65 


AT GW 


AT GW 


66 


ERDM 


BRDM 


67 


BTR60PK 


BTR-60PK 


68 


BMP76PB 


BMP-76PB 


69 


ETR152 


BTR-152 


70 


ETR50PK 


BTR-50PK 


71 


FIELD HWTZRS 


FIELD HOWITZERS 


72 


ASU65 


ASU-85 


73 


SU100 


SU-100 


74 


AIRBORNE 


AIRBORNE 


75 


LOWER LEFT 


LOWER LEFT 


76 


D3e 


D-30 


77 


AT3 SAGGER 


AT -3 SAGGER 


78 


ANTI-TK GUNS 


ANTI-TANK GUNS 


79 


D74 


D-74 


£0 


B 20 


D-20 


81 


M1955 


M-1955 


82 


D44 


D-44 


£3 


BM21 


BM-21 


84 


M1976 


M-1976 
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65 

be 

£7 

faB 

£9 

90 

91 

92 

93 

94 

95 

96 

97 

96 

99 

100 

101 

102 

103 

104 

105 

105 

107 

10S 

109 

110 

111 

112 

113 

114 

115 

116 

117 

118 

119 

120 

121 

122 

123 

124 

125 

126 

127 

126 

129 

130 

131 

132 

133 

134 

135 



3M24 


EM -2 4 


FR0G3 


FROG-3 


FR0G4 


FROG-4 


FRCG7 


FRCG-7 


SCUD A 


SCUD-A 


SCUD 3 


SCUD-B 


SS 12 SCL3RD 


SS -12 SCALS30ARD 


SSM 


SSM 


ATI SNAPPER 


AT-1 SNAPPER, 


65 MI DIMETER 


65 -MM 


100 MILIMETR 


100-MM 


SA4 GAME 


SA-4 GAN EF 


SA6 GAINFUL 


SA-6 GAINFUL 


SA6 GECKO 


SA-6 GECKO 


SA9 GASKIN 


SA-9 GASKIN 


LAUNCHERS 


LAUNCHERS 


THIRTEEN 


13 


ASW 


ASW 


FOURTEEN 


14 


AA GUNS 


AA GUNS 


FIELD GUNS 


FIELD GUNS 


ZU23/2 


ZU-23/2 


ZSU23/4 


ZSU-23/4 


ZSU57/2 


ZSU-57/2 


S60 


S-60 


M44 


M-44 


M49 


M-49 


57 MILIMETER 


5 7 -MM 


SU15 FLAGON 


SU-15 FLAGON 


YAK28P FRBAR 


YAK-2SP FIREBAR 


TU28P FIDLR 


TU-28P FIDDLER 


MIG19 FARMER 


MIG-19 FARMER 


MIG21 FSHBED 


MIG-21 FISHBED 


MIG23 FLGGSR 


MIG-23 FLOGGER 


MIG25 FOXBAT 


MIG-25 FOXBAT 


MIG27 FLGGER 


MIG-27 FLOGGER 


TU20 BEAR 


TU-20 BEAR 


TU126 MOSS 


TU-126 MOSS 


SU9 FISHPOT 


SU-9 FISHPOT 


MIG25R EX BAT 


MIG-25R FOXBAT 


TU22 BLINDER 


TU-22 BLINDER 


TU16 BADGER 


TU-16 BADGER 


TU25 BACKFIR 


TU-26 BACKFIRE 


M 14 HOUND 


MI-4 HOUND 


MI 12 HOMER 


MI-12 HOMER 


M 16 HOCK 


MI -6 HOCK 


Mie hip 


MI-6 HIP 


MI10 EARKE 


MI-10 EARKE 


M 124 HIND 


MI-24 HIND 


I L36 MAY 


IL-3S MAY 


M-4 B ISON 


M-4 BISON 
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136 

137 

136 

139 

140 

141 

142 

143 

144 

145 

146 

147 

146 

149 

150 

151 

152 

153 

154 

155 

156 

157 

156 

159 

160 

161 

162 

163 

164 

165 

166 

167 

168 

169 

170 

171 

172 

173 

174 

175 

176 

177 

178 

179 

180 

161 

152 

133 

164 

185 

166 



SU19 FENCE?. 
FIFTEEN 
AN5 CAN? 

AN 12 CUB 
AN22 COCK 
AN26 CURL 
KA15 HEN 
KA16 HOG 
KA25 HORMONE 
I L12 COACH 
I L14 CRATE 
IL26 BEAGLE 
IL76 CANDID 
A VACS 
BE12 MAIL 
TRANSPORTS 
FIGHTERS 
BOMEERS 
FIGHTER-BMRS 
STR IKE/ATT'CK 
HELICOPTERS 
RECONNAISN C 
SS 

FRIGATE 

SSB 

SSGN 

SSBN 

CARRIER 

CRUISERS 

DESTROYERS 

MINESWEEPERS 

FRIGATES 

CORVETTES 

MISSLS 

TORPEDO 

BOATS 

LANDING 

SIXTEEN 

INTELLIGENCE 

SHIPS 

SEVENTEEN 

EIGHTEEN 

KIEV CLASS 

MOSKVA CLASS 

SSN 

DELTA CLASS 
DELTA2 CLASS 
E0TEL2 CLASS 
H0TSL3 CLASS 
ASU57 

VICTOR CLASS 



5U-19 FENCER 

15 

AN-6 C AMP_ 

AN-12 CU3_ 

AN-22 COCK_ 
AN-26 CURL_ 
XA-15 HEN_ 

XA-16 KOG_ 

KA-25 HORMONE, 
IL-12 COACH, 
IL-14 CRATE, 
IL-28 BEAGLE, 
IL-76 CANDID, 

AW ACS 

EE-12 MAIL, 
TRANSPORTS 
FIGHTERS 
BOMBERS 

FIGHTER-BOMBERS 

STRIKE/ATTACK 

EELICOPTERS 

RECONNAISSANCE 

SS 

FRIGATE 

SSB 

SSGN 

SSBN 

CARRIER 

CRUISERS 

DESTROYERS 

MINESWEEPERS 

FRIGATES 

CORVETTES 

MISS IE, 

TORPEDO, 

BC ATS 
LANDING, 

16 

INTELLIGENCE, 

SHIPS 

17 

16 

KIEV CLASS, 
MOSKVA CLASS, 
SSN 

DELTA CLASS, 
DELTA II CLASS, 
HOTEL II CLASS, 
HOTEL III CLASS 
ASU-57 

VICTOR CLASS 
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187 

ise 

189 

19 0 

191 

192 

193 

194 

195 

196 

197 

196 

199 

200 

201 

2e2 

203 

204 

205 

206 

207 

208 

209 

210 

211 

212 

213 

214 

215 

216 

217 

218 

219 

220 

221 

?.c.c 

223 

224 

225 

226 

227 

228 

229 

230 

231 

232 

233 

234 

235 

236 

237 



YANKEE CLASS 
G0LF1 CLASS 
G0LF2 CLASS 
ZULU4 CLASS 
KRZSTA1 CLAS 
XRZSTA2 CLaS 
MIRKA1 CLASS 
MIRKA2 CLASS 
PETYA1 CLASS 
PETYA2 CLASS 
JULIET CLASS 
LOWER RIGHT 



YANKEE C L A S S _ 
GOLF I CLASS, 
GOLF II CLASS, 
ZULU IV CLASS 
KRSSTA I CLASS, 
XRESTA II CLASS 
MI REA I CLASS, 
MIRKA II CLASS, 
PETYA I CLASS, 
PETYA II CLASS, 
JULIET CLASS, 
LOWER RIGHT 



122 MI LIME TR 


12 2 -MM 


FOXTROT CLAS 


FOXTROT CLASS 


ROMEO CLASS 


ROMEO CLASS 


SSG 


SSG 


BRAVO CLASS 


ERAVO CLASS 


ECEOl CLASS 


ECHO I CLASS 


SCH02 CLASS 


ECHO II CLASS 


152 MILIMSTR 


152-MM 


TANGO CLASS 


TANGO CLASS 


WHISKEY CLAS 


WHISKEY CLASS 


CHAR LI El CLS 


CEARLIE I CLASS 


CHARLIE2 CLS 


CEARLIE II CLASS 


KARA CLASS 


KARA CLASS 


SVERDLOV CLS 


SVERDLOV CLASS 


KYNDA CLASS 


KYNDA CLASS 


KRIVAK CLASS 


KRIVAK CLASS 


KASHIN CLASS 


KASEIN CLASS 


240 MILIMSTR 


240-MM 


KANIN CLASS 


KANIN CLASS 


INTERCEPTORS 


INTERCEPTORS 


KOTLIN CLASS 


KOTLIN CLASS 


KOTLN SAM CL 


KOTLIN-SAM CLASS 


SKORY CLASS 


SKORY CLASS, 


RIGA CLASS 


ftlUA CLASS 


GRISHA CLASS 


GRISHA CLASS 


NANUCHKA CLS 


NANUCHKA CLASS 


POT I CLASS 


POT I CLASS 


OSA1 CLASS 


OSA I CLASS 


0SA2 CLASS 


OSA II CLASS 


KOMAR CLASS 


KOMAR CLASS 


STENKA CLASS 


STENKA CLASS 


NINETEEN 


19 


TWENTY 


20 


S HERS HEN CLS 


SHERSHEN CLASS, 


TWENTY-ONE 


21 


NATYA CLASS 


NATYA CLASS 


YURXA CLASS 


YURKA CLASS 


ALLIGATOR CL 


ALLIGATOR CLASS 


POLNOCNY CLS 


POLNOCNY CLASS 
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236 

239 

242 

241 

242 

243 

244 

245 

24c 

247 

24S 

249 

250 

251 

252 

253 

254 



TWENTY-TWO 

PR IMORYE CIS 

TWENTY-THREE 

TWENTY-JOUR 

SS16 

SS20 

5514 SCPGOAT 

55 15 SCROOGE 
ICBM 

IRBM 
MOBILE 
M242 
MORTARS 
ASSAULT GUNS 
ROCKET LCHRS 
AIRCRAFT 
TWENTY-FIVE 



22 

PRIMORYE CLASS, 

23 

24 

SS -1 6_ 

SS-22_ 

SS -14 SCAPEGOAT, 
SS- 15 SCROOGE, 

I OEM 
IRBM 
MOBILE, 

M-240 
MORTARS 
ASSAULT GUNS 
ROCKET LAUNCHERS 
AIRCRAFT 

25 
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APPENDIX 3 



SCENARIO CARDS 

TYPING CARDS ->>>>>>>> FIRST TWELVE 



INSTALLATION 0613-TU214 

i 

** 4 CONFIRMED 3MF-76PB APC 

7 CONFIRMED BREM APC ** 

i 

3 CONFIRMED AT-3 SAGGER ATGW ** 

** 4 PRCBAELE ZSU-23/4 AA GUNS 



i 

40 CONFIRMED T-54/55 MEDIUM TANKS ** 

xU xU 

V 'f 

4 PROBABLE Sk-9 GASKIN LAUNCHERS 

I 

I 

I 

I 

j ** 

6 PROBABLE ZU-23/2 AA GUNS 

__ | 

— “ ( — “ 



INSTALLATION 0115-T12314 

** 5 CONFIRMED M-4 BISON BOMBERS 

i 

** 1 P0SSI3LE TU-20 BEAR RECONNAISSANCE 



AIRCRAFT 



12 CONFIRMED TU-20 BEAR BOMBERS ** 

** 1 CONFIRMED TU-126 MOSS AW ACS 

i 

I 

XO xjj *” I 

2 CONFIRMED EE-12 MAIL RECONNAISSANCE 
AIRCRAFT i 

j 

7 CONFIRMED IL-28 BEAGLE BOMBERS ** 

17 CONFIRMED TU-15 BADGER BOMEERS ** 



** 3 PROBABLE TU-16 BADGER RECONNAISSANCE 
AIRCRAFT 
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INSTALLATION 0128-T13213 ** 

! / 

2 CONFIRMED KRESTA II CLASS CRUISERS 
3 CONFIRMED K REST A I CLASS CRUISERS ** 

I 

** 1 POSSIBLE TANGO CLASS SS 

i 

I 

I 

j 

‘SSc^^g^CCNFIRMED^WHISKEY^CLAS S"S S 

i 

2 PROBABLE CHARLIE II CLASS SSGN ** 

i 

i 

i 

i 

j 

1 CONFIRMED CHARLIE I CLASS SSGN 






i 

i 



i i 

i INSTALLATION 0298-T14218 

j j 

! 50 CONFIRMED ASU-65 AIRBORNE ASSAULT GUNS 

i j 

! 2? CONFIRMED ASU-5? AIRBORNE ASSAULT GUNS 

j ** j 

e i 

i i 

i i 

t i 

i i 

i i 

I i 

i ** 20 POSSIELE M— 240 HEAVY MORTARS 

i | 

|62 PR0BA5LE 122-MM D-30 FIELD HOWITZERS ** 

* i 

i i 

j j 

1 48 CONFIRMED 240-MM EM-24 ROCKET LAUNCHERS 

I i 

I I 

I «l« «JW | 

i — ] 

i 

i 
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INSTALLATION 0827-T21253 
6 CONFIRMED FOXTROT CLASS SS ** 

j 

12 CONFIRMED JULIET CLASS SSG 
** 2 PROBABLE DELTA II CLASS SSBN 

j 

3 PROBABLE DELTA CLASS SSBN 

I 

I 

"conjIrmsl"golJ ii~class~ssbn~** 

I 

I 

## 

5 CONFIRMED POTI CLASS CORVETTES 

i 

i 

** 2 POSSIBLE YANKEE'CLASS SSBN 

j 

7 PROBABLE ROMEO CLASS SS ** 



INSTALLATION 0405-T22217 

| ** 

40 CONFIRMED T-10 HEAVY TANKS 

i 

** 57 CONFIRMED T-34/85 MEDIUM TANKS 

** 43 CONFIRMED T-54/55 MEDIUM TANKS 



i 

i 

i 

3 CONFIRMEE PT-76 LIGHT AMPEIBEOUS TANKS 

** j 

** 6 CONFIRMED BTR-152 APC 

i 

j ## 

6 CONFIRMED BRDM RECONNAISSANCE APC 
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INSTALLATION 03E2-T23224 ** 

! / 

11 CONFIRMED TU-22 BLINDER BOMBERS 

i 

i 

20 CONFIRMED TU-26 BACKFIRE BOMBERS ** 
5 PROBABLE IL-2S BEAGLE BOMBERS 

j ** 



** 2 CONFIRMED IL-76 CANDID TRANSPORTS 

i 

i 

j £* 

15 CONFIRMED AN-12 CUB TRANSPORTS 

i 

i 

j 

7 CONFIRMED MI-8 HIP HELICOPTERS 



i 



INSTALLATION 0247-T24283 

i 

** 5 PROBABLE KOMAR CLASS MISSLE BOATS 

i 

i 

j ## 

17 CONFIRMER OSA I CLASS MISSLS BOATS 

i 

5 CONFIRMED OSA HARASS MISSLE BOATS 

** j 

“ ( 

i 

j 

** 7 CONFIRMED STENKA CLASS TORPEDO BOATS 






11 POSSIBLE NANUCHKA CLASS TORPEDO EOATS 



6 POSSIBLE GRISHA CLASS CORVETTES ** 

2 PROBABLE SHSRSHEN CLASS 'TORPEDO BOATS** 
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| INSTALLATION 0243-T3127S 

[ ## j 

i 12 CONFIRMED MIG-27 FLOGGZR STRIKE/ATTACK 
! AIRCRAFT | 

i 16 CONFIRMED SU-19 FENCER STR IKS/ ATTACK 
i AIRCRAFT I ** 

i i 

! 2 POSSIBLE MIG-25R FOXBAT RECONNAISSANCE 
i AIRCRAFT ** ! 



** 1 CONFIRMED IL-36 MAY ASV AIRCRAFT 

** j 

3 CONFIRMED AN-S CAMP TRANSPORTS 

t 

I 

5 CONFIRMED AN-26 CURL TRANSPORTS 

] 

! 

i 



INSTALLATION 0657-T32179 ** 

/ ## 

2 CONFIRMED HOTEL II CLASS SSBN / 

1 CONFIRMED HOTEL III CLASS SSEN 

i 

i 

i 

i 

i 

i 



i 

[ 

1 PROBABLE GOLF I CLASS SSB 

j 

1 PRCBAELE MIRKA I CLASS LIGHT FRIGATE 

I 

I 

| ** 

1 POSSIBLE ZULU IV CLASS SS 

I 



i 
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INSTALLATION 0410-T33252 

** 4 CONFIRMED 100-MM M-49 AA GUNS 

4 CONFIRMED ZSU-57/2 AA GUNS ** 

6 CONFIRMED 65-MM M-44 AA GUNS 

i 



/ ! 

6 CONFIRMED FROG-4 SSM MOEILE LAUNCHERS 

i 

i 

— — i 

j 

6 PROEABLE AT-1 SNAPPER ATGW 

i 

j 

4 CONFIRMED 122-MM D-74 FIELD GUNS 

i 

j ** 

21 CONFIRMED 85-MM D-44 ANTI-TANK GUNS 

i 



INSTALLATION 0173-T34246 ** ** 

1 CONFIRMED TU-126 MOSS AVACS / 

1 CONFIRMED TU-16 BADGER RECONNAISSANCE 
AIRCRAFT | 

15 CONFIRMED AN-22 COCK TRANSPORTS 

## j 

i 



18 CONFIRMED TU-20 BEAR BOMBERS 

/ 






12 CONFIRMED TU-22 BLINDER BOMBERS ** 



2 CONFIRMED TU-20 EEAR RECONNAISSANCE 



AIRCRAFT 



! 
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VOICE- 



UNBUFFERED CARDS -> > > NEXT TWELVE 



INSTALLATION 0156-V11250 ** 

j / 

9 PROBABLE YAK-28P_F I REBAR FIGHTER -BOBBERS 

** 12 CONFIRMED SU-15_FLAG0N INTERCEPTORS 

20 CONFIRMED TU-28P_FIDDLER INTERCEPTORS 

j ** 

j 

T3“probablFmig i 25“foxbat“interceptcrs““ 



11 POSSIBLE SU-9_F ishpot fighters ** 

! 

I 



15 PROBAELE MIG-21_FISHBED FIGHTERS** 

i 



INSTALLATION 0357-V12252 






1 CONFIRMED MOSKVA CLASS CARRIER 






1 CONFIRMED KIZV_CLASS CARRIER 

** 2 PROEABLZ KARA_C LASS CRUISERS 

j 

__________ ^ _____________________ 

** 3 CONFIRMED KASHIN_CLASS DESTROYERS 

** 4 CONFIRMED KRIVAK_CLASS FRIGATES 

## j 

8 CONFIRMED MIRKA II CLASS LIGHT FRIGATES 
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I 

INSTALLATION 0168-V 13259 ** 

6 PROBABLE 57-MMi S-60 MEDIUM AA_GUNS 

j * 

** 4 CONFIRMED SA-8_GICK0 LAUNCHERS 

i 

i 

i 

3 CONFIRMED SA-4_GANEF LAUNCHERS ** 

i 

i 

i 

i 

| 

4 CONFIRMED SA-6JJAINFUL LAUNCHERS 

j 

3 CONFIRMED SS-12_SC ALEBOARD MOBILE SSM 

[ £# 

5 CONFIRMED FROG-3 MOBILE SSM ** 

i 

i 

i 

** 4 CONFIRMED SA-9JJASKIN LAUNCHERS 

— ! — — — 



INSTALLATION 0 199-V 14197 

i ## 

16 CONFIRMED MI-4 HOUND HELICOPTERS 



j 

11 CONFIRMED MI-12_E0MER HELICOPTERS 

j 

** 5 PROBABLE MI-6 HOOK HELICOPTERS 



] ## 

21 CONFIRMED MI-10 HARKS HELICOPTERS 






19 PROBABLE MI-24 HIND HELICOPTERS 

i 
i 
i 
i 

i 
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INSTALLATION 02eS-V21221 

i j| t# 

1 CONFIRMS!) SS-16 MOBILE ICEM 

j 

** 1 PCSSIBIS SS-lb_SCRGOGE MOBILE I REM 
** 1 CONFIRMED SS -14_S CAPEGO AT MOBILE IREM 
2 PROBABLE SS-20 MOBILE IR3M ** 



** 1 CONFIRMED FROG-? SSM 

** 3 CONFIRMED SCUD_A SSM 

i 

i 



i 

1 POSSIBLE SCUD_B SSM 

i 
i 
i 

i 



INSTALLATION 2195-V22231 



10 CONFIRMED KA-25_H0RM0NE HELICOPTERS 

*£ ] ” 

| 

11 CONFIRMED MI-6 HI? HELICOPTERS 

T 

i 
i 
i 
i 

i 

i 

** 4 CONFIRMED KA-15_HEN HELICOPTERS 
** 6 CONFIRMED KA-16 HOG HELI COFTERS 



22 CONFIRMED IL-12 COACH TRANSPORTS 



22 CONFIRMED IL-14_CRATE TRANSPORTS ** 

i 
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INSTALLATION 0327-V23 249 

** 2 PROBABLE PRIMORYE CLASS INTELLIGENCE 

SHIPS ! 

i 

! 

3 CONFIRMED POLNOC NY_C LAS S LANDING SEIPS 

2 CONFIRMED ALL I G AT OR _C LAS S LANDING SHIPS 

' ** 



I 

I 

** | 

3 CONFIRMED YURKAJJLASS MINESWEEPERS 

i 

i 

** j 

2 POSSIELE NATYA_CLASS MINESWEEPERS 

4 PROEAELE PETYA_I_C LASS FRIGATES 

] ** 

i 

i 

i 



j 

INSTALLATION 0187-V2427? 

** 6B CONFIRMED BTR-60PK AMPHIEEOUS APC 
** 25 CONFIRMED T-62 MEDIUM TANKS 

i 

23 CONFIRMED 85-MM D-44 ANTI-TANK GUNS ** 



18 PROBABLE BM-21 ROCKET-LAUNCHERS 

i 

_ i 



i 

**22 CONFIRMED 122-MM D-3e FIELD-HOWITZERS 

i 

i 

** j 

19 CONFIRMED M-1955 FIELD-HOWITZERS 

i 

17 CONFIRMED M-1976 AIRBORNE ** 

ASSAULT GUNS i 
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I 

INSTALLATION 0528-V31176 

i 

** 11 CONFIRMED PETYA_I I_CLASS FRIGATES 
** 2 PROBABLE 3RAV0_CLASS SS 

i 

i 

## j 

3 CONFIRMED ECEO_I_CLASS SSGN 

i 

I 



j ## 

12 CONFIRMED ECHC_I I_CLASS SSGN 

j 

5 CONFIRMED RIGA.CLASS FRIGATES 



i 

i 



i 



i INSTALLATION 


0410-V32237 




! 22 


CONFIRMED 


BTR-50PK AMPEIBEOUS 


ARC ! 


! 40 


CONFIRMED 


T-72 HEAVY TANKS — 


j 


! IB 


PROBABLE SU-100 ASSAULT GUNS 








** j 




| ^*25 


CONFIRMED 


152-MM D-20 FI3LD_ 
« 


HOWITZERS | 



** j 

24 CONFIRMED 100-MM h-1955 FIELD GUNS 



i 

i 

** j 

13 PROBABLE M-1976 AIRBORNE ASSAULT_GUNS 

i 

i 

i 

i 

i 

i 

i 

i 
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INSTALLATION 0276-V33264 
15 CONFIRMED MIG-21_FISHBED FIGHTERS 

** j 

J 

12 CONFIRMED MIG-19 FARMER FIGHTER-BOMBERS 



** 11 PROBABLE MIG-23 FLOGGER FIGHTERS 

i 

_ i _ _ _ _ 



17 CONFIRMED 
AIRCRAFT 



IG-27_FL0GGER 

( 

I 

I 

I 

I 



STRIKE /ATTACK 



21 CONFIRMED MIG-25 FOXBAT INTERCEPTORS 

T 

I 

'T 5 ^ J 

3 POSSIELE TU-28P_FIDDLER INTERCEPTORS 



INSTALLATION 0362-V34273 

I 

** 2 PROBABLE SKORY^CLASS DESTROYERS 

i 

** 3 CONFIRMED KOTLIN_CLASS DESTROYERS 

i 

2 CONFIRMED KYNDA_CLASS CRUISERS ** 

5 CONFIRMED KANIN CLASS DESTROYERS 

** j ~ 

— , 

I 



2 CONFIRMED SVERDLOV CLASS DESTROYERS 









i 

i 

i 

i 



2 PROBABLE S HERSEEN CLASS TORPEDO BOATS 

i 

4 CONFIRMED KOTLIn'saM CLASS DESTROYERS 



i 

i 
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EUFFEREL-VCICE CARLS ->>>>> NEXT TWELVE 



i 



! INSTALLATION 0613-751214 




1** 4 CONFIRMEE EMP-76PE APC 




| 7 CONFIRMED BR DM 


APC ** 1 


| i 

13 CONFIRMED AT-3 SAGGER ATGW ** 

i i 




1 ** 4 PROBABLE ZSU-23/4 

1 1 ' 


AA_GUNS 1 


1 1 
I 43 CONFIRMED T-54/5E MEDIUM TANKS 


xj. 1 

't' ! 



! I 

I I 



4 PROBABLE 'SA-9_GASKIN LAUNCHERS 

! 

j ** 

5 PROBABLE ZU-23/2 AA_GUN S 

i 

i 



INSTALLATION 0115-V52314 

** 5 CONFIRMED M-4_BISON 30MEERS 

** 1 POSSIBLE TU-20^BSAR RECONNAISSANCE 
AIRCRAFT 

I 

12 CONFIRMED TU-20_BSAR BOMBERS ** 

** 1 CONFIRMED TU-126_MGSS AW ACS 

! 

## I 

2 CONFIRMED BS-12 MAIL RECONNAISSANCE 
AIRCRAFT i 

7 CONFIRMEE IL-2S_EEAGLE BOMBERS ** 

1? CONFIRMED TU-16_B ADDER BOMBERS ** 

** 3 FROBAELE TU-16^EADGER RECONNAISSANCE 
AIRCRAFT 
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INSTALLATION 0126-V53213 ** 

1 / 

2 CONFIRMED KRESTA_I I_CLASS CRUISERS 
3 CONFIRMED KRESTA_I_CLASS CRUISERS *# 

** 1 POSSIBLE 'TANGO.CLASS SS 

I 

I 

I 

I 

2~C ON FIRMED - WH Is ZEY~C LAS S~SS 

I 

2 PROEAELE CEAHLII_il_CLASS SSGN ** 

! 

i 

i 

1 CONFIRMED CHARLIE I CLASS SSGN 




i 



j 

INSTALLATION 0296-V5421S 

£0 CONFIRMED ASU-85 AIRBORNE ASSAULTJJUNS 

i 

2? CONFIRMED ASU-57 ' AIRBORNE ASSAULTJJUNS 

! 



I 

i 

l 

i 

l 

** 20 POSSIBLE M-240 HEAVY MORTARS 
62 PROBABLE 122-MNi D-30 FIE1D_H0WITZERS ** 

i 

i 

i 

48 CONFIRMED 240-MM EM-24 ROCKET-LAUNCHERS 

i 

j 
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INSTALLATION C627-V61253 
6 CONFIRMED FOXTROT_CLASS SS ** 

J -v 

12 CONFIRMED JULIET_CLASS SSG 
** 2 PRCEABLE DELTA II_CLASS SSEN 

T 

3 PROBAELE DELTA_CLAS5 SSEN 

i 

i 

4 - confTrmfd _ golf_II~class~ssrn - ** 

I 

I 

** J 

5 CONFIRMED POTI_CLASS CORVETTES 

1 

** 2 POSSIELE YANKEE^CLASS SSEN 

i 

7 PROBABLE ROMEO CLASS SS ** 



i 

INSTALLATION 0405-V62217 

40 CONEIRMED T-10 HEAVY TANKS 

** 57 CONEIRMED T-34/E5 MEDIUM TANKS 

** 43 CONFIRMED T-54/55 MEDIUM TANKS 

i 

i 

i 

i 

i 

i 

3 CONEIRMED PT-76 LIGHT AMPHIBIOUS TANKS 

** j 

** 6 CONEIRMED BTR-152 APC 

j 

j 

6 CONFIRMED BRDM RECONNAISSANCE APC 

i 

i 

i 

i 

i 

i 

i — 
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INSTALLATION 0352-V63224 



Sr# 



! / 

11 CONFIRM!!) TU-22 BLINDER EOMBERS 



20 CONFIRMED TU-26_BACKFIRE BOMBERS ** 

5 PROBABLE I L~28_BEAGLE EOMBERS-** 

I 

I 

I 

I 

I 

** 2 CONFIRMED IL-76_C ANDID TRANSPORTS 

\ 

i 

j ** 

15 CONFIRMED AN-12_CUE TRANSPORTS 

i 

j 

7 CONFIRMED MI-8 HIP HELICOPTERS 

i 

i 



i 

INSTALLATION 0247-V642S3 

i 

** 5 probable KOMAR JJ LASS missle EOATS 

I 

j ** 

17 CONFIRMED OSA_I_CLASS MISSLE BOATS 

i 

5 CONFIRMED OSA^II^CLASS MISSLE EOATS 

## i 



i 

i 

** 7 CONFIRMED STENKA_CLASS TORPEDO EOATS 

i ~ 
i 

** j 

11 POSSIBLE NANUCHEA_CLASS TORPEDO EOATS 

i 

6 POSSIELE GRISHA^CLASS CORVETTES ** 

2 PRCBAELE SHSRSHEN_CLAS S TORPEDO EOATS** 

i 

i 
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INSTALLATION 0243-V71278 

## j 

12 CONFIRMED MIG-27 F LOGGER STRIKE/ATTACK 
AIRCRAFT | 

16 CONFIRMED SU-19_FENCIR STR IKF/ATTACK 
AIRCRAFT | ** 

I 

2 POSSIBLE M IG-25R_F0XB AT RECONNAISSANCE 
AIRCRAFT ! 



** 1 CONFIRMED IL-3S_MAY ASW AIRCRAFT 

j 

3 CONFIRMED AN-S_CAMP TRANSPORTS 

i 

i 

i 

5 CONFIRMED AN-26_CURL TRANSPORTS 

j ** 

i 

i 

i 



INSTALLATION 0657-V72179 ** 

| / ** 

2 CONFIRMED HOTEL_I I_CLASS SSEN / 

1 CONFIRMED EOTEL III CLASS SSBN 

i ~~ 

i 

i 

i 

i 

i 

i 

i 

i 

** j 

1 PROBABLE GOLF_I _CLASS SSB 

** | 

1 PROBABLE MI RKA_I_C LASS LIGHT FRIGATE 

i 

i 

j 

1 POSSIBLE ZULU IV CLASS SS 



i 

! 
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INSTALLATION 0410-V73252 

** 4 CONFIRMED 100-MM M-4S AA_GUNS 

4 CONFIRMED ZSU-57/2 AA_GUNS ** 

5 CONFIRMED S5-MM M-44 AA_GUNS --** 

i 

i 

j 

/ 

£ CONFIRMED FRCG-4 SSM MOEILE LAUNCHERS 

! 

i 

i 

** j 

6 PROBAELE AT-1 SNAPPER ATGW 

“ i 

i 

j 

4 CONFIRMED 122-MM D-74 FISLD_GUNS 

i 

i 

i jjt* 

21 CONFIRMED 65-MM D-44 ANTI-TANK GUNS 



i 

INSTALLATION 0173-V74246 ** ** 

1 CONFIRMED TU-l26_M0SS AWACS / 

1 CONFIRMED TU-16_BADGSR RECONNAISSANCE 

A IRCR AFT 1 

16 CONFIRM) AN-22_C CCK TRANSPORTS 

j 

i 

i 

i 

i 

» 

i 

16 CONFIRMED TU-20 BEAR BOMBERS 

/ ! 

** I 

i 

12 CONFIRMED TU-22_BLINDER BOMBERS ** 

i 

i 

i 

2 CONFIRMED TU-20 BEAR RECONNAISSANCE 

AIRCRAFT | ** 

_ _______ i _ _, 

i 



i 
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APPENDIX C 



T600 TRAINING INSTRUCTIONS 

For this experiment a 264 word vocabulary will be used 
with the Threshold 600 (T600) voice recognition system. You 
will be required to speak each utterance ten times to train 
the T600 tc recognize your voice. Two sessions of 

approx ima t ely 90 minutes will be required to complete the 
training prior to experimentation. 

Please observe the following guidelines during training 
and operation of the T630 , as they will improve performance 
and reduce the time required for retraining. 

a. Use variety. Say the repetitions with the 
variety of intonation, emphasis, and volume 
you would expect to use in normal speech. 

d. Speak crisply without pausing. 3e natural 
and relaxed. Don't exaggerate or 

overemphasize; for example when saying the 
word "five", don't say "FI-I-VIE", thereby 
overemphasizing the end of the wcrd in an 
unnatural way. 
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b. Do the repetitions in groups to avoid breath 



noise and 


help 


you count the 


reps . 


For 


example to 


train 


the wcrd "zero" 


group 


the 



zeros as follows: 



000-000-000-0 

cr 

000 - 000-0000 
rather than - 

0000000000 
o r 

0 - 0 - 0 - 0 - 0 - 0 - 0 - 0 - 0 -0 

c. Adjust the microphone carefully, as 
demonstrated ( see the picture). 

e. Leave a distinct pause between words. Ycu 

must wait for the green READY light to come 
cn before saying the next utterance. 

f. Use the proper volume. Watch the meter? 
the needle should be in the green area cr 
just slightly in the red on the peek parts 
of the word. Words trained in the lower 
white or upper red will give poorer results. 
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Cnee you are comfortable with training the T600 , I will 
ask you to operate the keyboard for the remainder of the 
training. I will remain nearby to provide assistance as 
required. Ee sure to ask for help if you have any 
questions. Take breaks as you need them? a convenient place 
to break is every few pages. 

^%#x**##**********x Operating the T602 



To train a word - YOU TYPE 



T600 RESPONSE 



CTRL-U 

<word number> 
.e.g. 0 



WDff : 

<word prcrpt> 
ZERO 



Now you say the word or phrase 10 times. Once the current 
phrase disappears you are ready to go onto the next word of 
the vocabulary. Again you type CTRL-U and continue as 
before . 
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APPENDIX D 
TYPING TEST 

THE SOVIET NAVAL AIR FORCE 

FOR THE FIRST TIME IN ITS HISTORY, THE SOVIET NAVAL 
AIR FORCE WILL BE PUTTING TC SEA WITH ITS OWN AIRCRAFT 
EMBARKED ON THE FIRST OF THE NEW SOVIET AIRCRAFT CARRIERS, 
THE KIEV, WHICH HAD ALREADY EEGUN ITS WORKING-UP TRIALS IN 
TEE AUTUMN OF 1974. DISPLACING SOME 36,000 TONS WITH AN 
OVERALL LENGTH SLIGHTLY IN EXCESS OF 900 FEET, THE KIEV 
IS PRESUMED TO EMBARK 40-50 AIRCRAFT IN ALL, COMPRISING 
A MIX OF HELICOPTERS AND FIXED-WING V/STCL AIRCRAFT 
(TEE KIEV SHOWS NO SIGNS OF ARRESTER CABLES OR LAUNCH 
CATAPULTS}. THE SUGGESTED VERSION OF THE STRIKE AND 
RECONNAISSANCE FIGHTER TO BE EMBARKED ON THE KIEV IS THE 
YAK-36, A VERSION OF WHICH WAS TESTED ON THE AIRFIELDS NEAR 
MOSCOW AND GIVEN SEA TRIALS ON THE SOVIET HELICOPTER- 
CARRIER MOSKVA. THE YAK-36 UTILIZES VECTORED THRUST 
AND DIRECT LIFT IN COMBINATION. SUCH AN AIR COMPLEMENT 
MIGHT BE BROKEN DOWN INTO 30 KA-25 ASW HELICOPTERS AND 

15-20 V/STCL FIXED-WING AIRCRAFT. HOW MANY OF THESE 
CARRIERS WILL BE PRODUCED ? 

AT LEAST TWO OF THESE KIEV-CLASS AIRCRAFT CARRIERS ARE 
DUE TO ENTER SERVICE, WITH THE POSSIBILITY OF THE SOVIET 
NAVY PRODUCING A WHOLE CLASS OF SOME 6-£ SHIPS, THEREBY 



123 



FACILITATING CONTINUOUS DEPLOYMENT OF ONE VESSEL IN BOTH THE 
MEDITERRANEAN AND THE INDIAN OCEAN. TEE HELICOPTER 
COMPLEMENT PROVIDES INTENSIVE ASW CAPABILITY INTO DISTANT 
SEA AREAS (FOR DEFENSIVE AND OFFENSIVE PURPOSES), AS WELL AS 
FURNISHING AIRBORNE TARGET GUIDANCE FOR SURFACE-TC SURFACE 
ANTISHIP MISSLES. TEE V/STOL AIRCRAFT, WHILE PROVIDING A 
STRIKE CAPABILITY, MUST OBVIOUSLY INCREASE THE 
RECONNAISSANCE COVERAGE OF THE SOVIET NAVAL AIR ARM IN AREAS 
WHICH ARE BEYOND THE RANGE OF EXISTING LAND-EASED AIRCRAFT. 
MEANWHILE, THE ARMAMENT OF TEE KIEV-CLASS SHIPS IS ITSELF 
SIGNIFICANT. IT CONSISTS OF A TWIN LAUNCHER FOR ASW 
MISSLES, TWO 12-BARRELL MSU AS ROCKET LAUNCHERS, TWO SA-N-3 
SAM TWIN LAUNCHERS, A NUMEER OF RETRACTABLE SA-N-4 SAM 
LAUNCHERS, MULTIPLE 57-MM AAA MOUNTS AND SMALLER WEAPONS FOR 
CLOSE-IN PROTECTION AGAINST MISSLES AND OTHER GUIDED 
WEAPONS . 
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APPENDIX E 



PP.S/POST SUBJECTIVE QUESTIONNAIRE 

Subjective Questionnaire Narre: 

INSTRUCTIONS: Express your feelings regarding typed data 

entry and voice data entry. CIRCLE TEE NUMBER which EEST 
DESCRIBES your opinion for each question. 

1. Which data entry node do you think is the easiest to use 
to enter character strings and commands? 



Typed 

Data 

Entry 

<= <= <= 


Neutral 


V 

/ 


=> 


Voice 
La ta 
Ent ry 
=> 


12 2 


4 


5 


5 


7 


2. Which data entry 

for entering character 


mode do you 
strings and 


think is the 
commands? 


fas 


test mode 


Typed 

Data 

Entry 

<= <= <= 


Neutral 

* 


=> 


=> 


Voice 

Data 

Entry 

=> 


12 3 


4 


c; 


6 


7 


2. Which data entry 

character strings and 


mode is the 
commands? 


most accurate 


for 


entering 


Typed 

Data 

Entry 

<= <= <= 


Neutral 


=> 


=> 


Voice 
Data 
Ent ry 
=> 


12 3 


4 




6 


7 
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4. Which data entry node provides the nost flexibilit 
general, for interaction with a computer? 



in 



Typed 






Neutral 






Voice 


Data 












Data 


Entry 












Ent ry 


< = 


<= 


< = 


* 


=> 


=> 


=> 


1 


2 


3 


4 


5 


6 


7 



5. Which data 

several hours, if 


entry node would you prefer 
required ? 


to cp 


erate for 


Typed 

Data 

Entry 

<= <= 


<= 


Neutral 

* => 


=> 


Voice 

Data 

Entry 

=> 


1 2 


KJ 


4 5 


a. 

w 


7 


6. Which data entry node would you prefer 

more sporadic user of a computer system? 


tc operate as a 


Typed 

Data 

Entry 

<= <= 


< = 


Neutral 

* => 


=> 


Voice 
Da ta 
Ent ry 
=> 


1 2 




4 £ 


6 


7 


?. Which data 

operation? 


entry 


mode promotes the 


most 


relaxed 


Typed 

Data 

Entry 

<= <= 


< = 


Neutral 

* => 


=> 


Voice 

Data 

Entry 

=> 


1 2 


3 


4 5 


6 


7 
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Which data entry mode would he the most advantageous to 



use to update 
information? 


a n c n - 


line data 


base cf 


intelligence 


Typed 
Da t a 
Entry 
<= 


<= 


<= 


Neutral 

* 


=> 


=> 


Voice 
Data 
Snt ry 
=> 


1 


2 




4 


£ 


6 


7 


9. Which data 

interface in 

environment? 


entry mode provides the best men' 
a time-critical, high-pressure 


-machine 

work 


Typed 

Data 

Entry 

<= 


<= 


<= 


Neutral 


=> 


=> 


Voice 

Data 

Entry 

=> 


1 


c 


3 


4 


e; 


6 


7 


10. Which data 

learn? 


entry 


mode do you 


think is 


the easiest to 


Typed 
j^a t a 
Entry 
<= 


<= 


< = 


Neutral 


=> 


=> 


Voice 
Da ta 
Ent ry 
=> 


1 


2 


0 


4 


C, 


6 


7 
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APPENDIX F 



SUBJECT DATA SHEET 



Subject Data Sheet 



Date: 



Name: Age: 

Service: Rank/Grade: 

Job/Specialty Description (last job / next jcb) 



Prior to this experiment wnat has been ycur experience with 
voice data entry systems ? Check one or more. 

a. I have used a voice data entry system. 

b. I have seen a voice data entry system demonstrated. 

c. I have studied voice data entry systems (class, 

report, thesis, etc.) 

d. I have no experience with voice data entry systems. 

If you checked a. above, circle the term that best describes 
your experience and skill with voice data entry. 

Experience - Skill- 

Considerable High 

Moderate Average 

Minimal Novice 



Explain : 



If you checked c. above, please briefly state the extent 
of your studies. 
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APPENDIX G 

INSTRUCTIONS BRIEFED TO SUBJECTS 
TYPING MODE 

1. During this portion of the experiment you will view 12 
cards and use the ADM terminal to write a report on each 
card similar to the one you saw in the sample (or other 
portion of the experiment). I will step you after every 
four cards. This will give you a break and allow me to 
collect sore data. 

2. You will be using a text editor at the ISIE host 
computer. The edit keys discussed during training which may 
be used are shown cn the card at the terminal. You may edit 
errors only if you are on the line with the error in it, 
i.e. if you notice an error cn the previous line, do not 
attempt to correct it. However, I will demonstrate hew you 
ray void the previous line if you wish to do it over. 

3. Pencil and paper are provided if you want to use them to 
take notes as you lock in the viewport. 

4. Now practice on this card. 

5. <critique the repcrt> 

6. You are to go as fast as you can while trying to 
minimize errors. Keep in mind you are writing an 
intelligence report which should be timely, accurate, and 
complete. Questions? 

7. Ck, start. 

8. <Trial n 1> 

9. Ok, stop. Rest a moment, then you will do four more. 

1C. Ck, start. 

11. <Trial #2> 
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12. Ok, step. Rest a moment, this is the last set cf feur 
you will type for the experiment. 

13. Ok, start. 

14. <Trial »3> 

15. Stop. Yon deserve a break. Relax a while. You may 
^et up and move arcund, get a drink, etc. 
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VOICE-UNBUFFERED MODE 

1. During this portion of the experiment you will view 12 
cards, ana use the T6CC in unbuffered mode to write a report 
for each card like the one you saw in the sample (or ether 
part of the experiment). I will stop you after every four 
cards. This will save you a break and allow me to collect 
some data. 

2. The T603 unbuffered mode allows you to send the output 
corresponding to an utterance immediately to the host 
computer. Sc for example, when you say ’’CONFIRMED," it is 
sent immediately to the computer, and in this case, becomes 
a part of the text in tne text editor at the I3IZ computer. 
You may edit your input as long as you are on the line that 
has the error using the edit commands you trained. A list 
of tne edit commands you use is provided for you here, along 
with a list of the vocabulary as reference material. 

3. If ycu look in the viewport at this time, you will see 
that the three bottom lines of tne T600 display may be seen. 
These will provide a visual feedback of the text editor 
contents, and allow you to view the editing process as well 
as the card. 

4. Now practice using the sample card provided. 

5. <critique the report> 

6. Ycu are to go as fast as ycu can while trying to 
minimize errors. Keep in mind you are writing an 
intelligence report which should be timely, accurate, and 
complete. Questions? 

7. Ck, start. 

6. <Trial #1> 

9. Ok, stop. Rest a moment, then you will do four more. 

13. Ok, start. 

11. <Tria 1 #2> 
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12. Ck, stop. Rest a moment, this will be ycur last set cf 
four to enter for the unbuffered mode pert of the 
experiment . 

13 . Ck, start . 

14. <Trial #3> 

15. Stop. You deserve a break. Relax a while. You may 
get up and move around, get a drink, etc. 
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VOICE-BUFFERED YCOE 



1. During this portion of the experiment yon will view 12 
cards, and use tne T500 in buffered mode tc write a report 
for each card like the one you saw in the sample (or other 
part of the exper- iment). I will step you after every four 
cards. This will give you a break and allcw me to collect 
some data. 

2. The T600 buffered mode allows you to speak a chain of 
phrases prior to sending them tc tne nest computer. Ycu majr 
edit the last utterance in the buffer by saying "kill line’ 
or its equivalent for your vocabulary. If you make several 
errors, the entire buffer may be erased with the command 
"kill line." Once £ou are ready to send the contents of the 
buffer, you say "go* or "carriage return," whichever you 
trained, and the character string will be sent tc the text 
editor at ISIS. However, you will not be able to use the 
editing features of the text editor at ISIE while in the 
buffered mode. I will demonstrate the buffered mode for ycu 
now . 



2. If you look in the viewport at this time, you will see 
that the three bottom lines of tne T600 display may be seen. 
These will provide a visual feedback of the buffer contents, 
and allcw you to view the editing process as well as the 
card . 

4. Now practice using the sample card provided. 

5. <critique the report> 

6. Ycu are to go as fast as ycu can while trying to 
minimize errors. Keep in mind you are writing an 
intelligence report which should be timely, accurate, and 
complete. Questions? 

?. Ok, start. 

6. ^Trial #l> 

9. Ok, stop. Rest a moment, then you will do four more. 

10. Ok, start. 

11. <Trial #2> 
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12. C k , stop. Rest a moment, this v. i 1 1 he your last set cf 
four tc enter for the buffered •'"ode part of the experiment. 

1 c » Ck , start. 

14. <Tria 1 »3 . 

. Stop. You deserve a break. Relax a while. You may 
t up and move around, get a drink, etc. 
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APPENDIX H 



VOCABULARY WORDS MISRECOGN I ZED OR REJECTED 

NOTE: THE FOLLOWING LIST IS IN ASCENDING COLLATING SECUENC 

BY UTTERANCE AND MIS RE COG N I TON . THE M I SRSCOGN I TI ONS HAV 
TEE FOLLOWING FORMAT: 

A (B) X N 



WHERE 



A = UTTERANCE ASSOCIATED WITH T600 
MISRECOGNITION 

E = SPECIFIC TS00 OUTPUT, IF DIFFERENT 
THAN A ABOVE? Z.G." (2)" MEANS 
THAT A NUMERAL WAS OUTPUT RATHER 
THAN THE WORD "TWO" 

N = NUMBER OF OCCURENCES 





# # ?*S 5jc 3}; # # j{C # # # # # # # £ 3*5 # # # 


* UTTERANCE * 


* MISRECOGNITION (S ) * 


❖ # # # # # # * 




122 -MM 


100— MM X 2 


122 -MM 


152-MM X 3 


152-MM 


122-MM X 8 


85-MM 


57-MM 


AA GUNS 


AN-e CAMP X 6 


A A GUNS 


ANTI-TANK GUNS X 3 


AA GUNS 


YAK-28P FIREBAR 


AIRCRAFT 


ANTI-TANK GUNS 


AIRCRAFT 


CARRIER 


AIRCRAFT 


TU-26 BACKFIRE 


AMPHIBIOUS 


FRIGATES X 3 


AM-8 CAMP 


AA GUNS 


ANTI-TANK GUNS 


AMPHIBIOUS 


ANTI-TANK GUNS 


AN -8 CAMP X 4 


ANTI-TANK GUNS 


BEEP’ 1 ' X 6 


ASSAULT GUNS 


BEEP- X 16 


ASSAULT GUNS 


MISSILE 


ASU-57 


AT-3 SAGGER 


AT-1 SNAPPER 


BEEF* 


AT-2 SAGGER 


APC 


3M-21 


M-44 


BM-24 


3M-21 


BMP-7SPB 


BTR-60PK 


BOATS 


BEEP* 
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W M 



tO **» sV «A* J« *Xr V« 

•']■• t* 'r» -r 'r' 'r* -h' -v> 'i' 't* 

* UTTERANCE * 



*r 'i' * 1 * *r* *t* *\ 



$ # # # # # # # # # # # # # # SfcSjC # # # 



* MISRECOGNITION (S) 

*»* »•* »<■• o- ^ y* y« y« y« y# y» y« y< y« «ju *i» u« 
*v* -r* -I- 'i* nr 't' *v* -V 'r* *i' 'c -v* *r -t“ v «i» -r* <i‘ 



BOMBERS 

BOMBERS 

BOMEERS 

BOMEERS 

BRAVO 

BRAVO CLASS 

BRAVO CLASS 

BRAVO CLASS 

BRDM 

BRUM 

ETR-152 

BTR-50PK 

ETR-50PK 

ETR-60PK 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CARRIAGE RETURN 

CHARLIE I CLASS 

CEAF.LIE I CLASS 

CHARLIE I CLASS 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 



ALPHA (A) 

BEEP* X 7 

IL-14 CRATE X 2 

LAUNCEERS 

FRIGATE 

GOLF I CLASS 

KOMAR CLASS X 2 

KOTLIN CLASS X 2 

TORPEDO 

YANKEE 

NINETEEN (IS) 
BTR-60PK X 4 
D-20 

BTR-50PK X 3 
AN-8 CAM.? X 4 
BEEP* X 2 
BRDM 

CARRIER X 11 
FRIGATE X 2 
FRIGATES 
HEAVY X 3 
SSN 

VICTOR (V) 

XRAY (X) 

YAK-29P FIREBAR X 2 

ZSU-23/4 

FOXTROT CLASS 

KOTLIN CLASS 

MIRKA I CLASS X 2 

AIRBORNE 

BEEP* X 148 

EOMBERS 

BRAVO (B) X 4 

BRDM 

ELEVEN (11) X 6 
FIVE (5) X 7 
FOUR (4) 

HEAVY X 4 
KOTLIN CLASS 
LANDING 
LIMA (L) X £ 

MI-4 HOUND X 5 
MIKE (M) X 2 
NINE (9) 

NOVEMBER (N) X 2 
SA-e GECKO 
SEVEN (7) X 2 
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OU y-» y«* V# vO *X# 

^ ^ ^ r>' v ** % nr* n^ nr* *|* 



* UTTERANCE * 

*j++X0 %X? Jf ^ «ju 

rp ^ «^ n* *1* n* 



%V# V* «JU ^ «V V-" %V V# OU OU Vf >V Vf 

#|^ #j** nr* nr* n* np nf* n* m* n* n* n* nr n* n' nr 



* MISRECOGNITIGN (S ) * 

ifi # # # ajs 3 {< 5 (S # 5 *S # # 5 {c 5 j? ## 5 *C # 



CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CONFIRMED 

CRUISERS 

D-30 

D-44 

DASH 

DAS E 

DELETE LINE 

DELETE WORD 

DELETE WORD 

DELTA CLASS 

DELTA II CLASS 

ECEO I CLASS 

ECHO II CLASS 

ECHO II CLASS 

ECHC II CLASS 

EIGHT 

EIGHT 

EIGHT 

EIGHT 

EIGHT 

EIGHT 

EIGHT 

EIGHT 

EIGHT 

EIGHT 

EIC-HT 

EIGHT 

ZIGET 

SIGHT 

ELEVEN 

ELEVEN 

ELEVEN 

ELEVEN 

ELEVEN 

ELEVEN 

ELEVEN 

ERASE 

FIELD GUNS 
FIELD GUNS 



TEN (10) 

TWELVE (IF) X 7 
TWENTY (23) 
TWENTY-FIVE (25) 
TWENTY-ONE (21) 
UNIFORM (U) 

UPPER RIGHT 
XRAY (X) X 6 
Z SU-23/4 

TWENTY-THREE (23) 
D-74 

TWENTY-FOUR (24) 
QUEEEC (Q) 

TEN (10) 

LIMA (L) 

DELETE LINE (CTRL X) 
TWENTY-THREE (23) 
KOTLIN CLASS X 2 
GOLF II CLASS X 2 
PETYA I CLASS X 2 
DELTA II CLASS X 2 
PETYA II CLASS 
SEERSEEN CLASS 
AA GUNS X 4 
AMPHIBIOUS 
AN-S CAMP X 3 
APC 

ASU-S5 
BEEP* X 4 
EIGHTEEN (18) X 4 
FIFTEEN (15) 

FOUR (4) X 5 
HEAVY X 8 
KA-15 HEN X 14 
MEDIUM 
SA-8 GECKO 
YANKEE (Y) X 7 
BEEP* X 8 
D-20 

FIVE (5) X 2 
FOUR (4) 

ONE (1) X 3 
UPPER LEFT 
UPPER RIGHT 
EIGHT (8) 

BEEP* X 2 
JULIETT X 2 
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* UTTERANCE * 



FIELD GUNS 
FIELD HOWITZERS 
FIELD HOWITZERS 
FIELD HOWITZERS 
FIFTEEN 
FIFTEEN 
FIGHTER 

FIGHTER -BOBBERS 

FIGHTER -BOBBERS 

FIGHTER-BOMBERS 

FIVE 

FIVE 

FIVE 

FIVE 

FIVE 

FORTY 

FOUR 

FOUR 

FOUR 

FOUR 

FRIGATE 

FRIGATES 

FRIGATES 

FRIGATES 

FROG-3 

FROG -3 

FROG-4 

GO 

GO 

GO 

GO 

GO 

GO 

GO 

GOLF I CLASS 
GRISHA CLASS 
GRISHA CLASS 
GRISHA CLASS 
HEAVY 

HELICOPTERS 
HELICOPTERS 
HELICOPTERS 
HELICOPTERS 
HOTEL III CLASS 
11-14 CRATE 
INSTALLATION 
INSTALLATION 



# # # # # HjC # # # # 5iC # # # # & # J$C # SjS # # 

* MISRECOGNITION (S) * 






T-10 

BEEP 5 *' X 5 
HELICOPTERS X 4 
INTELLIGENCE 
EIGHTEEN (18) 
THIRTEEN (13) X 5 
FRIGATES 

ROCKET LAUNCEERS 
BEEP* X 3 
TWENTY-ONE (21) 
AN-8 CAMP 
BEEP* X 2 
NINE (9) X 2 
PAPA (P) X 2 
QUEBEC (Q) X 2 
TEREE (3) 

BEEP* X 33 
FROG -4 

LOWER RIGHT X 4 
MOBILE 
IL-38 MAY 
BEEP* 

FRIGATE 

SHSRSHEN CLASS 
BEEP* 

D-20 

PROBABLE 
3EEP* X 24 
BRAVO (B) X 2 
DELTA (D) 

ECHO (E) X 3 
GOLF (G) 

TWELVE (12) 

ZERO (0) 

OSA I CLASS 
KYNDA CLASS 
RIGA CLASS 
VICTOR CLASS 
SCUD B 
BEEP* X 3 
ERAVO (B) 

FOXTROT (F) 

MI-4 HOUND 
HOTEL II CLASS X 3 
MI-24 HIND 
BEEP* X 3 
S-60 
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* UTTERANCE * 



INTELLIGENCE 
INTERCEPTORS 
INTERCEPTORS 
JULIET CLASS 
KA-18 HOG 
KANIN CLASS 
KANIN CLASS 
KANIN CLASS 
KANIN CLASS 
KANIN CLASS 
KANIN CLASS 
KARA CLASS 
KARA CLASS 
KARA CLASS 
KARA CLASS 
KARA CLASS 
KASHIN CLASS 
KASHIN CLASS 
KASHIN CLASS 
KASHIN CLASS 
KASHIN CLASS 
KASHIN CLASS 
KIEV CLASS 
KIEV CLASS 
KIEV CLASS 
KIEV CLASS 
KIEV CLASS 
KIEV CLASS 
KIEV CLASS 
KILL LINE 
HILL LINE 
KILL LINE 
KILL LINS 
KILL LINS 
KILL LINE 
KILL WORE 
KILL WORD 
KILL WORD 
KILL WORE 
KOMAR CLASS 
KOMAR CLASS 
KOTLIN CLASS 
KOTLIN CLASS 
KOTLIN CLASS 
KOTLIN CLASS 
KOTLIN CLASS 
KOTLIN CLASS 



* MI SRSCOGN IT ION ( S ) * 

$ # # # # # # ;Js # & # # # # # # # # sjc # 



BEEP* X e 
BEEP* X 3 
HELICOPTERS X 6 
TURK A CLASS 
EIGHT (8) 

CARRIER 

KASHIN CLASS X 3 
KIEV CLASS 
KYNEA CLASS 
SHERSHEN CLASS X 4 
YANKEE CLASS X 5 
KANIN CLASS 
KOMAR CLASS 
KOTLIN CLASS X 3 
STENKA CLASS 
YURKA CLASS X 2 
JULIET CLASS X 8 
KANIN CLASS 
KOTLIN CLASS 
NATYA CLASS X 3 
SEERSEEN CLASS X 2 
YANKEE CLASS 
AIRCRAFT 
JULIET CLASS 
KANIN CLASS 
KARA CLASS 
KYNEA CLASS X 2 
SHERSHEN CLASS 
STENKA CLASS X 6 
CHARLIE ^C) X 6 
DELETE (CTRL X) 
KANIN CLASS X 2 
KOTLIN CLASS 
M-44 

MI -4 HOUND 
BEEP* X 6 
FIELD HOWITZERS 
KILL LINE X 2 
SEVEN 17) 

KARA CLASS X 2 
MIRKA I CLASS 
BRAVO CLASS 
CHARLIE II CLASS 
DELTA CLASS 
KASHIN CLASS 
KOMAR CLASS X 2 
MOSKVA CLASS 
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* UTTERANCE * 



%: ifi # # * 3*; sf: *: s£ # # £ £ # Jjs }■: jf: :•: s|: # sjt 

* MISRECCGN ITICN (S ) * 







# # # S*C # # # # # # # * # $ # # # £ Sjt # 


KOTLIN 


CLASS 


POLNC-CNY CLASS 


KOTLIN 


CLASS 


POT I CLASS 


KOTLIN 


CLASS 


UPPER LEFT 


KRESTA 


I CLASS 


CHARLIE I CLASS 


KRESTA 


I CLASS 


ECHO I CLASS 


KRESTA 


I CLASS 


OSA I CLASS X 4 


KRESTA 


I CLASS 


RIGA CLASS 


KRESTA 


II CLASS 


NANUCKKA CLASS 


KRESTA 


II CLASS 


OSA II CLASS 


KRIVAK 


CLASS 


KANIN CLASS 


KRIVAK 


CLASS 


KARA CLASS X 2 


KRIVAK 


CLASS 


KOTLIN CLASS 


KRIVAK 


CLASS 


KYNDA CLASS 


KYNDA 


CLASS 


KANIN CLASS X 6 


KYNDA 


CLASS 


NATYA CLASS 


KYNDA 


CLASS 


RIGA CLASS 


KYNDA ' 


CLASS 


STENKA CLASS X 7 


LANDING 


EEEP* 



LAUNCHERS 

LIGET 

LIGHT 

LIGHT 

LIGHT 

LIGET 

LIGHT 

LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER LEFT 
LOWER RIGHT 
LOWER RIGHT 
LOWER RIGHT 
LOWER RIGHT 
LOWER RIGHT 
LOWER RIGHT 
LOWER RIGHT 
LOWER RIGHT 
M-1955 
M-1S55 
M-1955 
M-1976 



MORTARS X 6 
E2EP* X 2 
FIVE (5) 

LOWER RIGHT X 2 
MIKE ( M ) X 4 
ONE (1) 

TWENTY (2?) X 3 
BEEP* X 19 
BTR-52PK 
CORVETTES X 2 
KOTLIN CLASS 
LIGET 

LOWER RIGHT X 9 
MOBILE X 3 
THREE (3) 
TWENTY-ONE (21) 
UPPER LEFT X 4 
BEEP* 

CONFIRMED 

LIGET 

LOWER LEFT 
ONE (1) X 3 
SEVEN (7) 
SEVENTEEN (17) 
UPPER RIGHT X 8 
ASU-65 
BEEP* X 2 
SU-15 FLAGON 
PT-75 
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.■< ^ a. yu gu •(« ou 

*V» *T* <Y* "T* '|^ V <y» .»r» -^s «>v<» 



*** *•» **• ^ «U **» «'# *A» vV ^ «v +?+ "'* y» <A« »*• OU Of 

t* 'i' •nr* ♦'<'■ n*“ <nr* »i* vr v *r* v »r»r'r v *>•* *«*« *>" 



* UTTERANCE * 

«1> »>* «l# <A» y« y. <A» <JL> Of JU «t> V' V' 

t t* v n' r ¥ 'r 'T' *1' -r or 'r 



- MISRECOGNITION(S) * 

j# v** ^ u# j# «J# «J<* o# y# j# u# v# o# 

*y* #p ^ >jf» ^ #p *p *p *p #p *p #p ^p #p 



M-242 
M-4 EISOM 
f“ -4 BISON 
M-4 BISON 
M-44 
M-4 9 
M-49 

medium 
M-ie HARKS 
MI -10 HARKE 
MI-12 HOMER 
MIG-19 FARMER 
MIG-21 FISHBED 
MIG-21 FISHBED 
MIG-23 FLCC-GER 
MIG-25 FOXEAT 
MIG-25R FOXBAT 
MIG-25R FOXBAT 
MIRKA I CLASS 
MIRK A I CLASS 
MIRKA II CLASS 
MIRKA II CLASS 
MIRKA II CLASS 
MIRKA II CLASS 
MIRKA II CLASS 
MISSILE 
MOBILE 
MOBILE 
MOBILE 
MOBILE 
MORTARS 
MOSKVA CLASS 
MOSKVA CLASS 
MOSKVA CLASS 
MOSKVA CLASS 
NANUCHKA CLASS 
NANUCEKA CLASS 
NANUCHKA CLASS 
NANUCHKA CLASS 
NANUCEKA CLASS 
NANUCHKA CLASS 
NATYA CLASS 
NATYA CLASS 
NATYA CLASS 
NATYA CLASS 
NATYA CLASS 
NATYA CLASS 



BEEP* 

BEEP* 

CHARLIE I CLASS 
MI-e HOOK 

TWENTY-FOUR (24) X 3 
M 19 5 5 

TWENTY-FIVE (25) 
BEEP* 

MI -24 HIND X 3 
MI-6 HIP 
MIG-19 FARMER 
RIGA CLASS 
IL-14 CRATE 
MIG-27 FLCGGER 
KA-25 HORMONE 
MIG-25R FOXBAT X 2 
KA-25 HORMONE 
MIG-25 FOXBAT X 3 
ECHO II CLASS 
PETYA I CLASS 
CHARLIE II CLASS X 2 
DELTA II CLASS 
KANIN CLASS 
KOTLIN CLASS X 2 
POLNOCNY CLASS 
TWELVE (12) 

3ESP* X 3 
BRAVO X 2 
HOTEL (H) 

PROBABLE X 6 
LAUNCHERS 
BEEP* X 2 
GOLF I CLASS X 3 
NATYA CLASS 
POLNOCNY CLASS X 5 
KOTLIN-SAM CLASS 
XYNDA CLASS 
SHERSHEN CLASS 
STENKA CLASS X 2 
YANKEE CLASS 
TURK A CLASS 
ALLIGATOR CLASS X 2 
BEEP* 

KANIN CLASS X 3 
KASHIN CLASS X 2 
KOTLIN CLASS 
KYNDA CLASS 
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0» •** •*>+ kV k*« wu k<« kU 


V# «JU ^ JU 

>1% T* nT ^ ^ ^ 


* UTTERANCE * 


* MIS RECOGNITION (S ) * 


Jjk ?JS ?JS 5jS <(S *{k rj% 3{C ^Jk jjs Jj% jjk 


* # * £ # # 3jt # # 3}: 3js # # # # J[S # # sis if if 


NATYA CLASS 


POTI CLASS 


MNI 


BEEP- X 2 


MINI 


FIVE (5) X 5 


NINE 


LIGHT 


NINE 


MI -6 HIP 


NINE 


MIKE (M) 


NINE 


TWENTY (20 ) X € 


NINETEEN 


EIGHTEEN 


NINETEEN 


MIKE (M) 


NINETEEN 


THIRTEEN (13) 


ONE 


BEEP* X 4 


ONE 


FIVE (5) X 7 


ONE 


EC-UR (4) 


ONE 


FOURTEEN (14) X 2 


ONE 


LIGHT X 2 


ONE 


M-44 


ONE 


UPPER RIGHT 


OS A I CLASS 


MIRKA I CLASS 


OSA II CLASS 


K.RESTA II CLASS X 2 


PETYA I CLASS 


NANUCHKA CLASS 


PETYA I CLASS 


YANKEE CLASS 


PETYA II CLASS 


ECHO II CLASS 


PETYA II CLASS 


HOTEL II CLASS 


PETYA II CLASS 


KASHIN CLASS 


PETYA II CLASS 


SEERSHEN CLASS 


POLNOCNY CLASS 


ALLIGATOR CLASS 


POLNOCNY CLASS 


BEEP* X 2 


POLNOCNY CLASS 


ECHO II CLASS 


POLNOCNY CLASS 


HOTEL II CLASS 


POLNOCNY CLASS 


HOTEL III CLASS 


POLNOCNY CLASS 


XOTLIN CLASS 


POLNOCNY CLASS 


MOSKVA CLASS 


POSSIBLE 


BEEP* 


POT I CLASS 


KANIN CLASS 


POT I CLASS 


KOTLIN CLASS X 3 


POTI CLASS 


MOSKVA CLASS X 6 


POT I CLASS 


ROMEO CLASS 


POTI CLASS 


WHISKEY CLASS X 2 


PRIMORYE CLASS 


ECHO I CLASS 


PRIMORYE CLASS 


MIRKA I CLASS 


PRIMORYE CLASS 


MIRKA II CLASS 


PROBABLE 


BEEP* 


PROBAELE 


BRAVO (B) X 7 


PROBABLE 


M03ILE X 3 


PROBABLE 


POSSIBLE 


PROBABLE 


TORPEDO 


PROBALBLE 


TWENTY-FOUR (24) 
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U# ^ u# s>i» V - V' ^ % v %'# 

#i% vrr 


* UTTERANCE * 


* MIS RECOGNITION (S ) * 


J/ •**+ O# J# v^i «JU J# v^# 

^ ^ #1^ #1^ #*p /|4 *p <p «p 


5js i\i 5js # # # # # ?jc # 5{c # ?{« # # # # ?{C # # # SjC 


RECONNAISSANCE 


SEEP* X 4 


RECONNAISSANCE 


CRUISERS 


RECONNAISSANCE 


GRISHA CLASS 


RECONNAISSANCE 


INTELLIGENCE X 2 


REPEAT LINS 


CARRIAGE RETURN (CTRL M) 


REPEAT LINE 


D-20 


REPEAT LINE 


M-240 


REPEAT LINS 


THREE (3) 


RETURN 


BEEF* X 4 


RETURN 


CONFIRMED X 5 


RETURN 


ELEVEN (11 ; 


RETURN 


SEVEN (7) X 2 


RETURN 


TEN (10) X 2 


RIGA CLASS 


GRISHA CLASS X £ 


RIGA CLASS 


VICTOR CLASS X 3 


ROMEO CLASS 


POLNOCNY CLASS 


S-60 


SS-16 


S-60 


SSG X 2 


SEVEN 


ASSAULT GUNS 


SEVEN 


BEEP* X 3 


SEVEN 


ELEVEN 


SEVEN 


FIVE (5) 


SEVEN 


SCUD A X 11 


SEVEN 


SEVENTEEN (17) 


SEVEN 


SI ERA (S) X 2 


SEVEN 


WHISKEY CLASS 


SEVEN 


ZSU-57/2 


SEVENTEEN 


SCUD A X 3 


SEERS ESN CLASS 


KANIN CLASS X 4 


SHIPS 


SIX (6) X 2 


SIX 


BEEP* 


SIX 


DESTROYERS X 3 


SIX 


FRIGATES 


SIX 


INDIA (I) 


SIX 


SCUD B 


SIX 


SHIPS X 9 


SIX 


SPACE ( ) X 20 


SIX 


T-72 


SIXTEEN 


BEEP* 


SIXTEEN 


FIFTEEN (15) X 4 


SPACE 


AMPHIBIOUS X3 


SPACE 


BACKSPACE (CTRL A) 


SPACE 


FRIGATES X 2 


SPACE 


SHIPS 


SPACE 


T-10 


ss 


SSGN 


ss 


SSM 
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## # # # # # # # # # # # 
* UTTERANCE * 

»■* *'< V* J# O* JU »'# V* «.!» %l< V" 

*v *v» »y» nr *t* *r- *t» 'f» *»*■ *r *v* ***■ *r» 


* MISRECCGNITION ( S ) - 

*** \*« r %*>* •*•*> WU y< *)» »'* •>* v>» V* *** %V 

*r 'V *y 'i *r n* v 'r ¥ »i'¥ ¥ n* 'r 'i" 


SS-14 SCAPEGOAT 

SS-20 

SS2 

SS BN 

SSBN 

SSG 

SSG 

SSGN 

SSGN 

SSGN 

SSGN 

SSGN 

SSM 

SSM 

SS N 

STENKA CLASS 

STENKA CLASS 

STENKA CLASS 

STENKA CLASS 

STENKA CLASS 

STENKA CLASS 

STRIKE/ATTACK 

STRIKE/ATTACK 

STRIKE/ATTACK 

SU-15 FLAGON 

SU-19 FENCER 

SU-A9 FISHPOT 

SVERDLOV 

SVERDLOV CLASS 

SVERDLOV CLASS 

SVERDLOV CLASS 

SVERDLOV CLASS 

T-34/65 

T-34/S5 

T-34/E5 

T-34/85 

T-34/B5 

T-54/55 

T-54/55 

T-54/55 

T-54/55 

T-62 

TANGO 

TANGO CLASS 
TANKS 
TANKS 
TANKS 


SA-S GECKO X 3 
SSF 

SSG X 6 
SSB X 5 
SSGN X 10 
SSF X 2 
SSGN 

CHARLIE I CLASS 
SSBN X 31 
SSG 
SSM 

SSN X 4 
SA-6 GAINFUL 
SSN X 20 
SSM 

JULIET CLASS 
KANIN CLASS 
KYNDA CLASS 
NATYA CLASS X 2 
SEERSHEN CLASS 
VICTOR CLASS X 2 
AN -8 CAMP 
BEEP* X 2 
M-1955 
IL-36 MAY 
SS-16 
BEEP* 

BEEP* 

OS A I CLASS X 2 
POLNCCN Y CLASS 
STENKA CLASS X 2 
YUF.KA II CLASS 
ASU-85 
M-1955 X 2 
MIG-21 FISH3ED 
T-54/55 

TU-26 BACKFIRE X 3 
BEEP* X 2 
BMP-76PB 
D-44 

T-34/S5 X 20 
TU-15 BADGER 
NINE (9) 

NATYA CLASS 
BEEP* 

BEEP* X 2 
HEAVY 
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JyC 5{% ji* Sp 5p <({ Jp 

♦ UTTERANCE * 


V* * V v# vW y# y* yu ^ Vf 

^ ^ ^ *** ^r» 

* MIS RECOGNITION (S) - 

# sjc :;c jje # # sje # t'fi # # # # # # sjs # ;Jc # # j?t 


TANKS 

TANKS 

TEN 

TEN 

THIRTEEN 

THREE 

THREE 

THREE 

THREE 

THREE 

THREE 

TEREE 

THREE 

THREE 

TEREE 

TU-22 BLINDER 

TU-26 BEAGLE 

TU-28P FIDDLER 

TWELVE 

TWELVE 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY 

TWENTY-FOUR 

TWENTY-ONE 

TWENTY-ONE 

TWENTY-THREE 

TWENTY-TWO 

LOWER LEFT 

TWENTY-TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 

TWO 


NINETEEN (IS) 

TWENTY (20) 

BEEP* 

ELEVEN (11) 

FIFTEEN (15) 

CARRIER 

FOURTEEN (14) X 2 
FRIGATE X 8 
F ROG -3 
HEAVY X 2 
MI-8 HIP 
THIRTEEN (13) 

TWENTY (23) 

TWO (2) 

WHISKEY (V) 

TU-20 BEAR 
IL-14 CRATE X 2 
MIG-23 FLOGGER 
BEEP* 

GOLF 

BEEP* X 4 
D-30 

FOURTEEN (14) 

LIGHT 
KIKE (M) 

NINETEEN (19) 

ONE (1) 

UPPER RIGHT 
TWENTY-CNE (21) 

TJiTTTP# Y ^ 

TWENTY-FOUR (24) X 2 

FROG-3 

BEEP* X 2 

LOWER RIGHT X 9 

TWENTY-THREE 

BEEP* X 12 

ETR-152 

SIGHT (8) 

FIFTEEN (15) 

FOUR (4) X 2 
FRIGATE 
HEAVY 
LIGHT 

MEDIUM X 4 
T-10 
T-62 
T-72 
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Vf ^ yu y# y# y# ^ «y* y# 

-y* #1^ #p «*|% #p ^ ^ 

* UTTERANCE * 

si: is i!r if; s!r iir 5*r i!r ^ 5!s is 



TW C 
TWO 
TWO 
TWO 
TWO 
TWO 
TWO 

UNIFORM 
UPPER LEFT 
UPPER LEFT 
UPPER LEFT 
UPPER LEFT 
UPPER LEFT 
UPPER LEFT 
UPPER LEFT 
UPPER RIGHT 
UPPER RIGHT 
UPPER RIGHT 
UPPER RIGHT 
UPPER RIGHT 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 
VICTOR 

VICTOR CLASS 
VICTOR CLASS 
VICTOR CLASS 
VICTOR CLASS 
VICTOR CLASS 
WHISKEY CLASS 
YAK-26P FIREBAR 
YAK-26P FIREBAR 
YANKEE CLASS 
YURKA CLASS 
YURKA CLASS 
YURKA CLASS 



y^ V-* ^ y# y^ y* y# y^ y# y# y# y# V* y^ y^ y^ 

^ ^ <y* wp ^ ^ ^ ^ #p /|S 



* MISRSCCGNITION(S) * 

## ###### #####5*5 #*##### # 



TEN (le) X 4 
THREE ^ 3 ) X 6 
TU-22 BLINDER 
TWENTY-TWO (22) X 5 
YAK-26P FIREBAR 
ZSU-57/2 X 12 
ZU-23/2 X 8 
BRDM 

BEEP* X 21 
BRAVO CLASS X 3 
EIGHTEEN (18) 

ELEVEN (11) 

KOTLIN CLASS X 3 
LOWER LEFT X 5 
UPPER RIGHT X 5 
BEEP* X 6 
LIGHT 

LOWER LEFT X 4 
LOWER RIGHT X 9 
UPPER LEFT X 7 
BEEP* X 17 
CARRIAGE RETURN 
CARRIER X 2 
D-30 

FIFTEEN (15) X 2 
FRIGATE X 2 
HEAVY 

INDIA (I) X 2 
(1-1955 

NOVEMBER (N) 

QUEBEC (Q) X 2 
SA-S GECKO 
THREE (3) X 2 
TU-22 BEAR 
WHISKEY 
BEEP* 

KARA CLASS 
KYNDA CLASS X 2 
MIRKA II CLASS 
NANUCHKA CLASS 
KANIN CLASS 
MIG-19 FARMER 
TU-26P FIDDLER 
KANIN CLASS X 4 
KYNDA CLASS 
PRIMORYE CLASS 
VICTOR CLASS X 3 
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* UTTERANCE v 

%V 4# 4# V* 4/ Uf 4# JU 4# \V 

^ ^ ^|% 4|W tf % 4,% ^ 


5jc # # # Jf: # # sjs # # # # # ;{: sjc # # # # # # 

* MSRECOGNITION (S) * 

4# •>** 4/ %'<* 4# 4<» %•# 4# 4# 4* %i# 4U V 41 4# 4# 4# 4« 4# >V» 4f 

#1% 4|% /,% 4|% /f% 4|^» #-|% #p /p ^ 4|% /p 


ZERO 

ZERC 

ZERO 

ZERC 

ZSU-23/4 

ZSU-57/2 

ZSU-57/2 

ZSU-57/2 

ZU-23/2 

ZU-23/2 

ZU-23/2 


BACKSPACE (CTRL A) 
KILO (A) X 2 
NOBILE 

ZSU-57/2 X 2 
ZU-23/2 X 2 
ASU-57 
ZSU-23/4 
ZU-23/2 
SU-19 FENCER 
TU-22 BLINDER 
TU-26 BACKFIRE 
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APPENDIX I 



RESULTS FOR PRE/POST SUBJECTIVE QUESTIONNAIRE 

The following data reflect whether subjects" attitudes 
shifted either toward typing or voice as a result cf the 
experiment. A two-tailed sign test was used. Note: Means 
for the pre/post given below may be misleading if thought to 
be indicative of the shift. Tne sign test looks at the fact 
of whether their was a shift or not, and ignores the amount 
of shift in the analysis, since the amount may be somewhat 
arbitrary . 



QUESTIONS and 
PRS / POST MEANS 
for 20 subjects. 


SHIFTS 
towa rd 
TYPING 


SHIFTS 
towa rd 
VOICE 


NO 

SHIFT 


OC =.10 

S ignif ? 


1. Which data entry mode 
do you think is the 
easiest to use to enter 
character strings and 
commands? (5. 1/6.1) 


V 


12 


5 


YES 


2. Which data entry mode 
do you think is the 
fastest mode for entering 
character strings and 
commands? (5, 1/5. 6) 


3 


13 


4 


YES 


3. Which data entry mode 
is the most accurate for 
entering character 
strings and commands? 

(4. 1/4. 8) 


4 


9 


? 


NO 


4. Which data entry mode 
provides the most 
flexibility, in general, 
for interaction with a 
computer? (5. 1/5.1) 


4 


12 


4 


YES 


5. Which data entry mode 


3 


8 


9 


NO 



would you prefer tc 
operate for several 
hours, if required? 
(4.374.3) 
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CUEST IONS and 
PRE / POST N.EANS 
for 20 subjects. 



SHIFTS SHIFTS 
toward toward NO 
TYPING VOICE SHIFT 



6. Which data entry mode 
would you prefer to 
operate as a more 
sporadic user of a 
computer system? 

14.3/4.3) 



7. Which data entry mode 
promotes the most relaxed 
operation? (5.0,5. 1) 

6. Which data entry mode 
would be the most 
advantageous to use to 
update an on-line data 
base of intelligence 
information? (5. 1/5.0) 

9. Which data entry mode 

provides the best 
man-machine interface in 
a time-critical, high 
pressure work 

environment? 15.0/5.0) 

10. Which data entry 
mode do you think is the 
easiest to to learn? 
14.9/5.6) 



3 10 7 



5 S 7 

3 9 5 






12 



2 13 5 



« 



oc =.10 
Signif? 



YES 



NO 



NO 



NC 



YES 



149 



LIST OF REI ERENCES 



1. Lea, W. A., Treads in Speech Recogni t i oa , Preati ce-Hall 

Inc., p. 68-69, I960. 

2. Naval Postgraduate School Report NPS-55-60-01S , 

Experiments with Voice Input for Corn - , and aad Coatrcl , 
hy G.K.Foock, April 1960. 

3. Lawson, m J. S., "Naval Tactical C3 Architecture 1985- 

1995," Signal, p. 72-75, August 1976. 

4 . Lea , op . ci t . , p . 3. 

5. Rome Air Development Center Briefing, ”D0D Automated 

Exploitation System," February 1961. 



5. 


Ibid 


• 






7. 


Lea , 


op . c it . , 


P. 


30-3 


6 . 


Lea , 


op . c i t . , 


r> 

t • 


4e. 


9. 


Lea , 


op. c i t . , 


P • 


24. 


10 . 


Lea , 


op . ci t . , 


P- 


92. 


11. 


Lea , 


cp . c it . , 


P • 


4-7. 



12. Reek, B., Meuberg, E.P. and Eodge, D.C., ' An Assessment 

of the Technology of Automatic Speech Recognition for 
Military Applications," IEEE Transactions Acoustics, 
Speech, and Signal Processing, ASSP-25, Number 4, p. 
310-322, 1977. 

13. Rome Air Development Center Report RADC-TR-60-220 , DIMS 

Voice Data Entry , by Phillips B. Scott, Threshold 
Technology Inc., June 1980. 

14. Rome Air Development Center Report RADC-TR-76-209 , Word 

Recognition . by Phillips B. Scott, Threshold 
Technology Inc., September 1978. 



150 



13. P.orre Air Development Center Report RADC-TR-77-184 , 
Alpha/Numeric Extraction Technique Phase II , by 
Phillips 3. Scott, Threshold Technology Inc., (“'ey 

1977. 

16 . Foock , op . loc . 

17. McSorley, W., Using Voice Recognition to Run the Warfare 
Snv ironment ""Simulator (WES) , Masters Thesis , Naval 
Postgraduate School, Monterey, California, March 1961. 

IS. Rome Air Development Center Report RADC-TR-80-74 , 
Advanced Image Exploitation Aids , by Jchn R. Welch 
and 6. Sharnsi, March I960. 

19. Pccck, op. lcc. 

22. Threshold 620 User's Manual, Threshold Technology Inc., 

1978. 

21. Conners, E., and Vance C., "Operation of the .0-1132 

Harvard Tachi stoscope and Peripheral Equipment," Naval 
Postgraduate School CS 3SS5 Paper, p. 1-3, September 
1978. 

22. United States Strategic Institute Report, USSI 76-2, 

Soviet Warsaw Pact Force levels , by J. Erickson, 1976. 

23. Donnely, C., and others, The Soviet War Machine: An 

Encyclopedia of Russian Military Equipment and 
Strategy , Chartwell Becks, Inc. 1978. 

24. Defense Intelligence Agency BBE-2682-42-78, Handbook on 

the Soviet Armed Forces . February 1976. 

25. Wiener, E. , The Armies of the Warsaw Pact nations . 2nd 

ed., Carl Ueberreuter Publishers, 1978. 



151 



INITIAL DISTRIBUTION LIST 



N o . 



1. Defense Technical Information Center 
Cameron Station 

Alexandria, Virginia £2134 

2. Superintendent 

ATTN: Library, Cede 0142 
Naval Postgraduate School 
Monterey, California 93940 

3. Superintendent 

ATTN: Department Chairman, Code 55 
Naval Postgraduate School 
Monterey, California 93940 

4. Superintendent 

ATTN: Professor J. Arima, Code 55Aa 
Naval Postgraduate School 
Monterey, California 93940 

5. Superintendent 

ATTN: Professor R. lister, Code 5531a 
Naval Postgraduate School 
Monterey, California 93940 

6. Superintendent 

ATTN: CDR W. Morcney, USN, Code 55Mp 
Naval Postgraduate School 
Monterey, California 93940 

7. Superintendent 

ATTN: Professor D. Neil, Code 55Ni 
Naval Postgraduate School 
Monterey, California 93940 

8. Superintendent 

ATTN: Professor G. Pccck, Code 55Pk 
Naval Postgraduate School 
Monterey, California 93940 

9. Superintendent 
ATTN: Code 312A 

Naval Postgraduate School 
Monterey, California 93940 



Copies 

2 

2 

1 

1 

1 

1 

1 

10 



152 



10. Superintendent 1 

ATTN: Cede 39 

Naval Postgraduate School 
Monterey, California 9 3940 

11. Air Force Institute of Tecnnclcgy/CIS? 1 

ATTN: Major Charles Earnhart, USAF 

Wright Patterson Air Force Base 
Ohio 45433 

12. Air Force Intelligence Service/IND 2 

ATTN: It Cel W. Cray, USAF 

Eollir.g AFB, Washington, D.C. 20332 

13. Rome Air Development Center/IRR 2 

ATTN: K. Benfeld, IDES 

Griffiss AFB, New York 13441 



13. Rome Air Development Center/IRRA 2 

ATTN: Lt J. Woodard 

Griffiss AFB, New York 13441 

14. Aeronautical Systems Division/RWT 1 

ATTN: Lt Col J. Turinetti 

Tactical Reconnaissance Projects 
Wright Patterson AF3, Ohio 45433 

15. Strategic Air Command/INXY 2 

ATTN: Capt Greg Jay, USAF 

Offutt AFB, Nebraska 68113 

16. American Sterilizer Company 1 

ATTN: T. Brendgcrd 

2424 West 23rd St 
Erie, Pennsylvania 16152 

17. Crew Systems Technology 1 



ATTN: Donald L. Parks 
Boeing Commercial Airplane Co. 

P.0. Box 3707 
MS 47-08 

Seattle, Washington, 98124 

16. Dipl.-ing Eartmut Mutschler 1 

Wissencraftl .Mitarbeiter 
Fraunhofer-Institute Fur 
Inf ormations-Und Da tenverebeit ing 
Rintheimer Strabe 19 
D-7500 Karlsruhe 1 
Germany 



153 



1 



19. General Dynamics 
ATTN: J. Mice Byrd 
Nail Zone 8227-1 
P.0. Box £5106 
San Diego, California 92138 

20. Eabcox and Wilcox 1 

Nuclear Pov»er Generation Division 

ATTN: Robert L. Starkey 
P.O. Box 1260 
Lynchburg, Virginia 24505 

21. International Telephone and Telegraph 1 

Great Easters House 

Human Factors 
ATTN: Barry Drake 
Edinburgh Way 
Harlow, Essex 
England 

22. Texas Instruments, Inc. 1 

Human Factors 

ATTN: Kenneth C. Bice 
P.C. Box 2909 
NS 2201 

Austin, Texas 76763 

23. Walt Goede 1 

Consul tan t 

31051 Hawksmoor Drive 

Rancho Palos Verdes, California 90274 

24. International Telephone and Telegraph 1 

ATTN: H. Rudy Ramsey 

1000 Oronoque Lane 
Stratford, Connecticut 06497 

25. Lear Siegler, Inc 1 

ATTN: Ivan Belya 

4141 Eastern Avenue S. E. 

NS 128 

Grand Rapids, Michigan 49506 

26. TRW 1 

NTS-Me n-Machi ne Interface 

System Design Department 
ATTN: C. E. (NED) Wilkins 
Cne Space Park 

Redondo Beach, California 90278 



154 



27. 



1 



TRW 

Systems Analysis Department 
ATTN: Matthew F. Carroll 
MS 75-190 
One Space Park 

Redondo Beach, California 90279 

26. American Telephone and Telegraph 1 

ATTN : R . E . Cochrane 

Engineering Maniger for Human Factors 
Rocm 4C154 

Bedminster, New Jersey 07921 

29. General Motors Corporation 1 

Industrial Relations Staff 

Direct or- Ergonomics 
Health Services 
ATTN: Roger L. Kuhn 
3044 West Grand Blvd. 

Detroit, Michigan 46202 

30. Northrop Corporation 1 

ATTN: Jeffrey E. Miller 

2301 West 120th Street 
Hawthorne, California 90250 

31. Northrop Corporation 1 

Electronics Division 

ATTN: Compass Preview Program Manager 
1 Research Park 

Palos Verdes Peninsula, California 90274 

32. John Herchenroder 1 

204 North Wakefield Street 

Arlington, Virginia, 22203 

33. Sperry Univac 1 

ATTN: Michael L. Schneider 

Computer Scientist 
P.O. Box 500 

Elue Bell, Pennsyl vanni a 19424 

34. U.S. Army Human Engineering Lab 1 

ATTN: Richard N. Armstrong 

Eox 476 

Fort Rucker, Alabama, 36362 



1 



35. Ohio State University 

Industrial and Systems Engineering 



1 



ATTN: Gayle L. Berry 
1971 Neil Avenue 



Columbus, Ohio 43210 



36 . 



University of Nebraska at Lincoln 



1 



Industrial Engineering 
ATTN: David J. Cochran 
Lincoln, Nebraska 65586 



37. Systems Research laboratories 
Human Factors Engineering 
ATTN: Chris Hale 
2600 Indian Ripple Read 
Dayton, Ohio 45440 



1 



38. University of California 



1 



Computer Science and Applied Math Department 

Lawrence Berkeley Lab 

ATTN: Aaron Marcus 

Building 503 

Room 2238 

Berkeley, California 94720 

39. Eunker Ramo 1 

Electronic Systems Division 

ATTN: CATIS Program Manager 
31717 La Tienda Drive 
Box 5009 

Westlake Village, California 91359 

40. Texas Instruments, Inc. 1 

Electronic Systems Division 

ATTN: TIPI Program Manager 
Lewisville, Texas 75067 

41. Harris Corporation 1 

ATTN: Larry Lamb 

MS 22/2419 
F.O. Box 37 

Melbourne, Florida 32901 

42. Rodney Elden 1 

Management Consultant 

5 Middle Road 

Bronxville, New York 10708 



156 



1 



43. Defence and Civil Institute cf 
Fnvi ronmental Medicine 
ATTN: Ing. L. Van Ereda 
F . 0 . 3cx 2002 
1133 Sheppard Avenue West 
Downsview, Ontario 
Canada MM 3B9 

44. Naval Ocean Systems Center 1 

ATTN: Carl Rcsengrant, Cede 6141 

San Diego, California 92152 

45. Merck and Corrpany 1 

ATTN : Nancy Woo 

R 84-17 
Box 20e0 

Rahway, New Jersey 27065 

46. National Aeronautics end Space Administration 1 

ATTN: E. L. Weiner 

MS 23903 

Moffett Field, California 94035 

47. Naval Undersea Systems Center 1 

ATTN: Anthony Bessacini, Code 3522 

Newport, Rhode Island 02S43 

48. National Security Agencey 1 

ATTN: John F. Boehm 

R542 

Fort Meade, Maryland 2075o 

49. Naval Training and Equipment Center 1 

ATTN: R. 3reaux, Code N-711 

Orlando, Florida 32S13 

50. Office of the Undersecretary of Defense 1 

Research and Engineering 

ATTN: Cdr Paul Ch atelier, USN 
Room 3D129 

Pentagon, Washington, D.C. 20301 

51. National Aeronautics and Space Administration 1 

ATTN : Clay Coler 

MS 23902 

Moffett Field, California 94235 



157 



52. Naval Undersea Systems Center 1 

ATTN: Dianne Davis, Cede 3522 

Newport, Rhode Island 02640 

53. Naval Undersea Systems Center 1 

ATTN: Edward De Gregario, Code 3522 

Newport, Rhode Island 22340 

54. U.S. Army Engineer Topographic and 1 

and Research Institute 

ATTN : Tice De Y cung 

Fort Eelvoir, Virginia 22060 

55. U.S. Army Applied Technology lab 1 

Fort Eustis, Virginia 23662 

56. United States Postal Service 1 

Research and Development Lab 

ATTN : Harold C. Glass 
11711 Parklawn Drive 
Rockville, Maryland 20852 

57. Air Force Aerospace Medical Research lab 1 

ATTN: Don Me Kechnie 

Wright Patterson AFE , Ohio 45433 

56. Air Force Aerospace Medical Research Lab/EBA 1 

ATTN: Thomas J. Moore 
Wright Patterson AFB, Ohio 45433 

58. Air Force Aerospace Medical Research Lat/BBM 1 

ATTN: Capt Vince Mortimer, USAF 

Wright Patterson AFB, Ohio 45433 

59. Naval Aerospace Medical Research Lab 1 

Acoustical Sciences Division 

ATTN: James Mcskc 
Naval Air Station 
Pensacola, Florida 32506 

60. U.S. Army Signal Center 1 

Directorate of Training 

ATTN: Capt Leslie Scofield, (JSA 
Fort Fordcn, Georgia 30905 

61. Naval Air Development Center 1 

ATTN: C. Skriver, Cede 6021 

Warminster, Pennsylvania 13974 



156 



62. Naval Undersea Systems Center 
ATTN: S. Nils Straaveit, Code 317 
New London, Connecticut 26320 

63. Fleet Material Support Office 
ATTN: Leahrrond Tyre, Code S333 
Mechanic sdurg , Pennsylvania 17255 

64. Air Force Weapons Analysis Laboratory/FGE 
ATTN: Eric Werkow i tz 

Wrieht Patterson AFE , Chic 45433 

65. Naval Air Development Center 
ATTN: T. Weiner, Code 4243 
Warminster, Pennsylvania 16974 

66. Naval Air Systems Command 

ATTN: Cdr Chuck Hutcnins , Air-340F 
Jefferson Davis Highway 
Arlington, Virginia 20362 

67. Army Communicative Technology Office 
ATTN: Major W. MacHarrie 

Eox 4337 

Fort Eustis, Virginia 23604 

68. National Securtity Agency 
ATTN: Charles Wayne 

R54 

Fort Meade, Maryland 20755 

69. DAVAA-Z 

Avionics Research and Development 

ATTN: Lockwood Reed 

Fort Monmouth, New Jersey 07703 

70. Army Research Institute 
PER 1-0 U 

ATTN: J. N. McConnell 
5001 Eisenhower Avenue 
Alexandria, Virginia 22333 

71. Air Force Aerospace Medical Research Lab/SEA 
ATTN: P.ichard McKinley 

Wright Patterson AFB , Chio 45433 



1 

1 

1 

1 

1 

1 

i 

1 

-1 

1 



72. Texas Instruments, Inc. 

ATTN: George Doddington 
Box 225936 

MS 371 

Dallas, Texas 75243 

73. IBM Research Center 
ATTN : N . Rex Dixon 
Box 2lS 

Yorktown Heights, New York 10598 

74. Massachusetts Institute of Technology 
ATTN: Victor Due 

Room 36-543 

Cambridge, Massachusetts 02139 

75. Eolt, Beranek, and Newman, Inc. 

ATTN: Jared Volf 

50 Moulton Street 

Cambridge, Massachusetts 02238 

76. Naval Air Development Center 
ATTN: Norm Warner, Code 6021 
Warminster, Pennsylvania 18974 

77. Robert Lynchard 
3165 McCrory Place 
Orlando, Forida 32803 

78. Naval Aerospace Medical Research Lab 
ATTN: Cdr Janes Goodson 

Naval Air Station 
Pensacola, Florida 32508 

79. Armament Division/XRC 
ATTN: H. 2. Brown 
Fglin AF3, Florida 32541 

80. Naval Aerospace Medical Research Lab 
Acoustical Sciences 

ATTN: Carl Williams 
Naval Air Station 
Pensacola, Florida 52508 

81. Naval Air Test Center 

Systems Engineering Test Directorate 
ATTN: Andrew Cruce, Code 57030 
Patuxent River, Maryland 20670 



1 

1 

1 

1 

1 

1 

1 

1 

1 

1 



160 



£2. Internal Revenue Service 1 

ATTN: Thomas Cullen 
1201 East Street NW 
Washington, D.C. 20224 

£3. Internal Revenue Service 1 

ATTN: Klaus Erosius 
1201 East Street NW 
Washington, E.C. 20224 

84. Vertex Corporation 1 

ATTN : Janet Baker 
Two Oak Park 

Bedford, Massachusetts 01730 

£5. United States Postal Service 1 

Research and Development Lah 
ATTN: Arnold Craft 
11711 Parklawn Drive 
Rockville, Maryland 20852 



£5. Army Research Institute 1 

ATTN: Irv Alderman 
5001 Eisenhower Avenue 
Alexandria, Virginia 22333 

£7. Naval Ocean Systems Center 1 

ATTN: John Phillips, Code 7232 
San Diego, California 92152 

£S. Wayne Lea 1 

£89 Sanford Court 
Santa Barbara, California 93111 

£9. Naval Electronics Systems Center 1 

ATTN: Jrank Deckelman, Code 330 
2511 Jefferson Davis Highway 
Arlington, Virginia 20360 

90. Naval Ocean Systems Center 1 

ATTN: Bruno White, Code £302 

San Diego, California 92152 

91. Naval Ocean Systems Center 1 

ATTN: William Dejka, Code 8302 

San Diego, California 92152 



161 



92. Advanced Research Projects Agency/IPTO 1 

ATTN: Lcdr J. Dietzler, USN 

1420 Wilson Blvd. 

Arlington, Virginia 22362 

93. Bolt, Beranek, end Newman, Inc. 1 

ATTN: Richard Pew- 

52 Moulton Street 

Cambridge, Massachusetts 22136 

94. University of Missouri at Columbia 1 

Industrial Engineering Department 

ATTN: Marlin Thomas 

Room 113, Electrical Engineering Building 
Columbia, Missouri 64211 



S5. Office of Naval Research 1 

ATTN: M. Talcctt, Code 455 
£00 North Cuincy Street 
Arlington, Virginia 22217 

96. Office of Naval Research 1 

ATTN: G. Malecki, Code 455 

Arlington, Virginia 22217 

97. Eolt, Beranek, and Newman, Inc. 1 

ATTN: N. Greenfield 

52 Moulton Street 

Cambridge, Massachusetts 22136 

98. Air Force Human Resources Lab/TT 1 

ATTN: Col Richard Shelton, USAF 

Lowry AFB , Colorado 62230 

99. Armed Forces Air Intelligence Training Center 1 

ATTN: Capt Dick Rewalt 

Euilding 360 

Lcwry AFB, Colorado 80230 

120. University of Southern California 1 



Information Sciences Institute 

ATTN: R. Bisbey 

4676 Admiralty Way 

Marina Del Pay, California 90291 

101. Naval Ocean Systems Center 1 

ATTN : R . Kolb, Code 624 
San Diego, California 92152 



162 



1 



1 02. Commander in Chief Pacific Fleet 
ATTN: Car R. Meinnold, Code £4 
3cx 6 

Pearl Earbcr, Hawaii 96860 

103. Stanford Research Institute 
Artificial Intellignce Center 
ATTN: Daniel Sagalowicz 

33 Ravenswood Avenue 
Menlo Park, California 9422.5 

104. Science Applications Incorporated 
ATTN: Russ Hammond 

Suite 1200 

1911 North Fort Meyer Drive 
Arlington, Virginia 22209 

105 . S . Parsons 

19740 Via Escuela Drive 
Saratoga, California 95270 

136. University of Michigan 

Industrial Engineering Department 

ATTN: Don Chaffin 

Ann Arbor, Michigan 48104 

106. University of Michigan 
Industrial Engineering Department 
ATTN: Walt Hancock 

Ann Arbor, Michigan ,46104 

107. Noval Ccean Systems Center 
ATTN: Dennis McCall, Code 6242 
San Diego, California 92512 

106. Office of Naval Research 

ATTN: Marvin Benicoff, Code 437 
620 North Quincy Street 
Arlington, Virginia 22217 

129. Naval Ocean Systems Center 

ATTN: John Schill, Code 92152 
San Diego, California 92152 

110. University of Pennsylvania 
Wharton School of Business 
ATTN: E. Morgan 
Room W-63, Dietrich Hall 
Philadelphia, Pennsylvania 19104 



1 

1 

1 

1 

1 

1 

1 

1 

1 



163 



111. Naval electronics Systems Command 
ATTN: Dan Schutzer, PMI 126 

2511 Jefferson Davis Highway 
Washington, D.C. 22360 

112. Advanced Research Projects Agency/IPTO 
ATTN: R. Kahn 

1400 Wilson Elvd. 

Arlington, Virginia 22209 

113. Threshold Technology, Inc. 

ATTN: Tom Martin 

1629 Underwood Blvd. 

Delran, New Jersey 06075 

114. Threshold Technology, Inc. 

ATTN: Joe Bove 

1629 Unaerwooa Blvd. 

Delran, New Jersey 06275 

115. Threshold Technology, Inc. 

ATTN: Phillips Scott 

1529 Underwood Blvd. 

Delran, New Jersey 06275 

115. Advanced Research Projects Agency/CTO 
ATTN : Craig Fields 
1422 Wilson Blvd. 

Arlington, Virginia 22209 

117. Commandant of the Marines 
Scientific Adviser 

ATTN: A. L. Slafkosky, Code RD-1 
Washington, D.C. 20360 

118. Institute for Defense Analysis 
ATTN: Jesse Crlansky 

402 Army-Navy Drive 
Arlington, Virginia 22222 

119. Naval Ocean Systems Center 
ATTN: Glen Allgaier, Code 6242 
San Diego, California 92152 

120. Air Force Aerospace Medical Research Lab/HIF 
ATTN : Den Topmiller 

Wright Patterson AFB, Chio 45433 



* 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 



164 



1 



121. Naval electronics Systems Command 
ATTN: R. Fratilla, Code 330 

2511 Jefferson Davis Highway 
Arlington, Virginia 22360 

122. Naval Electronics Systems Command 
ATTN: J. Machodo, Code 332 

2511 Jefferson Davis Highway 
Arlington, Virginia 20362 

123. Capt John Armstrong 

6445 Sugar Creek Way 
Orleans, Ontario 
Canada SIC 1Y1 

124. Department of National Defence 
NDHS DAS Eng. 4 

ATTN: Lt Col J. A. Wellington, CAE 
101 Colonel by Drive 
Ottawa, Ontario 
Canada K1A 0E2 

125. Rome Air Development Center/IRRA 
ATTN: R. Vonusa 

Griffiss AF3 , New York 13441 

126. Lt Col Ma rk Smith, USA? 

9520 Braddock Road 
Fairfax, Virginia 22032 

127. Computer Corporation of America 
ATTN: Chris Eerot 

575 Technology Square 
Cambridge, Massachusetts 02139 

128. Digital Equipment Corporation 
ATTN: Paul Thordarson, ML3-2/E41 
146 Main Street 

Maynard, Massachusetts 0213S 

129. Thomas J. Watson Researcn Center 
ATTN: John Gould 

Box 218 

Yorktown Heights, New York 12598 

130. Lockheed Missile and Space Division 
Department 86-10 

ATTN: Leon Herman 
Box 182 
Building 504 



1 65 



1 

1 

1 

1 

1 

1 

1 

1 

1 



Sunnyvale, California 94086 

131. Biotechnology, Inc. 1 

ATTN: Harold Price 

322? Rosemary Lane 

Falls Church, Virginia 22242 

132. Maj Warren Watkins, USAF 1 

1 STRAD/D02 

Vandenburg AFE, California 9343? 

133. Olin Campbell 1 

Suite 201 

1150 South State Street 
Orem, Utah 8405? 

134. Commander in Chief Pacific Fleet 1 

TRW Field Office 

ATTN: George Harris, Code N-34 
Pearl Harbor, HI 96862 

135. Air Force Aerospace Medical Research Lab/HEC 1 

ATTN: Lew Hahn 

Wright-Pa tterson AFE, Ohio 45433 

136. California Institute of Technology 1 

Jet Propulsion Laboratory 

Systems Analysis Section 
ATTN: Robert L. Sohn 
4800 Oak Grove Drive 
Pasadena, California 91103 

13?. Massachusetts Institute of Technology 1 

Lincoln Laboratories 
ATTN : Cliff Weinstein 
Room B-335 

Lexington, Massachusetts 021?3 

138 . David Jc ly 1 

2180 Bryant Street 

San Francisco, California 94110 

139. Naval Training Equipment Center 1 

Human Factors Laboratory 

ATTN: Elizabeth Lambert, Cede N-?ll 
Orlando, Florida 32813 



166 



1 



140. Threshold Technology, Incorporated 
ATTN: Fred Gladney 
Suite 4 - Cl 

1440 South State College Blvd. 

Anaheim, California 9260c 

141. Heuristics, Inc. 1 

ATTN : Tom Imperatc 

1285 Hammerwood Avenue 
Sunnyvale, California 94266 

142. XYBICN 1 

ATTN: Paul Frost 

7 Ridgedale Avenue 

Cedar Knolls, New Jersey 07927 

143. Threshold Technology, Incorporated 1 

ATTN: John Welch 

1629 Underwood Elvd. 

Delran, New Jersey 26075 

144. Office of Naval Research 1 

ATTN: Robert Wisher, Code 456 

820 North Quincy Street 
Arlington, Virginia 22217 

145. Honeywell, Incorporated 1 

Systems and Researcn Center 

ATTN: Robert North 
2620 Ridgeway Elvd. 

Minneapolis, Minnesota 55413 

146. National Eureau of Standards 1 

Information-Communications Systems Technology 

ATTN : Dave Pa 11 ett 
A219 Technology Building 
Washington, D.C. 22234 



157 



Thes is 

J345 

c.l 



Jay 



1 




192411 

An experiment i n 
voice data entry for 

•magery interpretat ion 
reporting. 



' & f tto a 3 

ML .>* cj 
3 Jc* o5 



28Hii 

*0123 
3 2 5 P p 



Thes is 192411 

J345 Jay 

c.l An experiment in 

voice data entry for 
imagery interpretation 
reporting. 



